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Abstract. We investigate classes of orthogonal representations of compact Lie groups that 
have isometric orbit spaces. We find invariants and general structural results of such classes. 
Our main technical result provides a geometric description of classes which contain represen- 
tations with very different algebraic properties. Such classes contain most representations 
arising naturally in geometric problems, for instance, representations of low copolarity and 
most representations of low cohomogeneity. 



1. Introduction 

1.1. Motivation. For an orthogonal representation p : G — > O(V) of a compact Lie group 
G, the quotient metric space V/G is the most important invariant of the action, at least 
from the metric point of view. We are going to call two representations pi : Gi — > 0(Vi), 
i = 1, 2, quotient- equivalent if V\/G\ and V2/G2 are isometric. If dim(G 2 ) < dim(Gi), 
the representation p 2 will be called a reduction of p\. If p 2 does not admit a reduction, it 
will be called a minimal reduction of p\ and the dimension of G 2 will be called the abstract 
copolarity of p\ (for reasons that will become clear in the sequel). A representation that does 
not admit a reduction will be called reduced] in this case, we will refer to the dimension of 
its underlying group as its abstract copolarity. 

Beyond the natural question of finding a minimal element in a quotient-equivalence class, 
our interest in reductions is two-fold. On one hand, the existence of a reduction implies 
some, probably severe, restrictions on the original representation. The reduction simplifies 
the action and bounds its "complexity" and that of the singular quotient space. On the other 
hand, while most representations do not admit reductions (see below), many geometrically 
interesting ones do. For instance, it is the case for many representations of low cohomogeneity 
and for the important class of polar representations. These are representations admitting 
reductions to discrete groups; in the terms above, a representation is polar if and only if 
its abstract copolarity is (see Subsection 12 .3 j) . Another class is built by representations 
with non-trivial principal isotropy groups, and, generalizing both previous examples, by 
representations with non-trivial copolarity |GOT04j . These are representations, for which 
the isometry / : V2/G2 — > V\/G\ of a reduction can be realized via an isometric embedding 
V 2 — >■ V\ and a homomorphism G 2 — > G\ (up to orbit-equivalence, cf. Subsection 12. 3p i.e., 
when one can find a reduction "inside" the original representation. The minimal dimension 
of all reductions of this kind is called the copolarity of the representation (see Subsection 12. 3ft ; 
in particular, the abstract copolarity is bounded above by the copolarity. 

It seems interesting to understand non-reduced actions and to describe their minimal 
reductions. In the case of (abstract) copolarity 0, i.e., in the case of polar actions, the 
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Strictly speaking, representations of discrete groups are always polar and have trivial copolarity. 
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cohomogeneity can be arbitrarily large and all such actions (with connected group) have been 
classified |Dad85t [EH99, B erOlj . In the case of higher copolarity, it seems to be extremely 
involved and, at the moment, not very promising to describe all reducible representations. 
For irreducible ones there is more hope. In |GUT04j it has been proved that an irreducible 
representation of a connected group G has copolarity 1 if and only if it has cohomogeneity 3. 
Those have been classified ( |HL71j ; see also |Uch80[ IYas86I IStr96] ) and appear in many 
geometric problems (cf. |GT03j ). 



1.2. Results. While methods of submanifold geometry have been strongly used in [GOT 04J. 
here we only apply some elementary observations concerning the geometry of quotients to 
describe the minimal reductions of irreducible representations of connected groups of low 
copolarity. We prove: 

Theorem 1.1. Let p : H — )■ O(W) be a non-reduced non-polar irreducible representation of a 
connected compact Lie group H . If the copolarity k of p is at most 6, then the cohomogeneity 
of p is exactly k + 2. 

As mentioned above, we prove Theorem 11.11 by only using the fact that the action and its 
reduction are quotient equivalent, and by studying the invariants of their quotient equivalence 
class. Some geometric invariants of quotient equivalence classes like cohomogeneity or the 
property of being polar (Subsection 12.31) are easy to find. It seems to be considerably more 
difficult to derive helpful algebraic invariants from the geometric properties of the quotient. 
The bulk of our paper consists in studying on quotient equivalence classes a variant of the 
most simple algebraic property: reducibility of the representation. While reducibility or ir- 
reducibility of a representation is an invariant of the quotient equivalence class (Lemma 15. ip . 
the restriction of the representations to the respective identity components may behave dif- 
ferently for different representations in one class. That it indeed happens in many important 
cases can be seen at the example of irreducible representations of connected groups whose 
minimal reductions have Abelian identity components (for instance, if the abstract copolarity 
is at most 2). 

Our main result describes all quotient equivalence classes in which reducibility of the 
restricted representation of the identity component is not (!) an invariant of the class: 

Theorem 1.2. Let p : H — > 0(W) and p' : H' — >■ 0(W) be quotient equivalent representa- 
tions. Assume that the action of the identity component H° on W is irreducible and that of 
(H')° on W is reducible. Then there is precisely one effective representation r : G — > 0(V) 
in the quotient class of p and p' which has trivial copolarity. If this quotient equivalence 
class is non-polar, then the identity component of G is a torus T k and its action on V can 
be identified with that of a maximal torus ofSXJ(k + 1) on C k+1 . 

As the most important special case we obtain: 

Corollary 1.3. Let p : H — >• 0(W) be a non-reduced non-polar irreducible representation of 
a connected compact Lie group H. Let r : G — > O(V) be a minimal reduction of p, which we 
assume to be effective. Let G° be the identity component of G. If G° acts reducibly on V, 
then G° is a torus T k and its action on V can be identified with that of a maximal torus of 
SU(fc + l) on C k+1 . 

Further remarks are in order. First of all, there are infinite series of representations 
satisfying the assumptions of Corollary II. 3\ see [GO T04J. All examples appearing therein 



have simple relations to some slightly larger polar representations. In general, it seems that 
all representations satisfying the assumptions of Corollary 11.31 have interesting geometric and 
topological properties and are closely related to isoparametric submanifolds. We expect to 
address geometric properties and characterizations of such representations in a forthcoming 
work. 

Note that Theorem 11.11 follows directly from Theorem 11.21 if the copolarity is 1, 2 or 5. 
The remaining cases as well as the proof of Theorem 11.21 are based on the observation that 
a representation can admit a reduction only if its quotient has a non-empty boundary, see 
Proposition 15.21 On the other hand, it is quite difficult for a representation to have non- 
empty boundary in the quotient. While it is possible to analyze the existence of the boundary 
in each concrete case, it seems quite difficult to describe all such representations. In the case 
of simple groups, such classification has been announced by Kollross and Wilking. If such 
a classification could be carried out for non-simple groups as well (which should be much 
more difficult), one probably could describe all representations admitting reductions. 

A few cases that we could not exclude by direct geometric arguments are ruled out in the 
second part of the paper, in which we provide a classification of all irreducible representations 
of connected groups acting with cohomogeneities 4 or 5. These classifications are of indepen- 
dent interest and should be useful for other purposes as well. We would like to mention that, 
unlike the case of cohomogeneity 3, (and, probably, the case of all cohomogeneities larger 
than 5), in cohomogeneities 4 and 5 there are only a few representations and no families. As 
a by-product of the classification, there is an example of cohomogeneity 5 and copolarity 7, 
which shows that Theorem 11.11 is not valid for k = 7. The classification is summarized as 
follows: 

Theorem 1.4. The non-polar irreducible representations of connected compact Lie groups 
of cohomogeneities 4 or 5 as well as their copolarities and presence or not of boundary in 
the orbit space are listed in the following two tables. 



G 


P 


Copolarity 


Boundary 


SO(3) 


R 7 


trivial 


no 


U(2) 


C 4 


trivial 


no 


SO(3) x G 2 


R 3 ® R R 7 


2 


yes 


SU(3) 


S 2 C 3 


2 


yes 


SU(6) 


A 2 C 6 


2 


yes 


SU(3) x SU(3) 


C 3 ® c C 3 


2 


yes 


E 6 


C 27 


2 


yes 



Table 1: Cohomogeneity 4 



G 


P 


Copolarity 


Boundary 


SU(2) 


C 4 


trivial 


no 


SO(3) x U(2) 


R 3 ® R R 4 


trivial 


yes 


SU(4) 


S 2 C 4 


3 


yes 


SU(8) 


A 2 C 8 


3 


yes 


SU(4) x SU(4) 


C 4 ® c C 4 


3 


yes 


SO(4) x Spin(7) 


R 4 ® R R 8 


3 


yes 


U(3) x Sp(2) 


C 3 ® c C 4 


7 


yes 



Table 2: Cohomogeneity 5 
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1.3. Explanation. We would like to explain the general strategy of this paper by sketching 
the proof of Theorem 11.11 in the case of k = 1. Thus let us assume that r : G — > 0(V) is the 
minimal reduction of an irreducible representation p : H — )■ 0(W) of a connected group H . 
Assume further that dim(G) = 1, i.e., that G° is a circle U(l). Since p is irreducible, so 
must be r (Lemma 15. II) . Hence the action of G must act transitively on the set of isotypical 
components of V with respect to the action of G°. Since G° is a circle and the action is 
effective, we deduce that there is only one G°-isotypical component and it is given by the 
complex multiplication of U(l) on a complex vector space V = C l . For I = 1, the action 
is polar, thus it is not the minimal reduction. Hence I > 2. From Proposition 15.21 we 
deduce that W/H = V/G = (V/G°)/T has non-empty boundary, where T is the discrete 
group G/G°. Hence the quotient of the unit sphere S(V)/G = (S(V)/G°)/T has non-empty 
boundary as well. But S(V)/G° is the complex projective space CP 1 ^ 1 . The finite quotient 
CP l ~ 1 /T can have non-empty boundary if and only if some element of T acts as a reflection 
at a totally geodesic hypersurface. But such hypersurfaces exist in CP 1 ^ 1 only for I = 2. 
Thus V = C 2 . 

1.4. Questions. We would like to finish the introduction by formulating some basic ques- 
tions about quotient-equivalence classes, closely related to our results. 

Question 1.1. Assume that pi : Gi — > 0(Vi), where i — 1, 2, are effective, reduced and 
quotient-equivalent. Is it true that the pi must be equivalent as representations? 

Question 1.2. Let the irreducible representation of G on V be reduced. What is the isometry 
group of the quotient space V/G? Can it be much larger than the N(G)/G, where N(G) is 
the normalizer of G in O(V)? 

Question 1.3. For a representation p : G — > O(V) of a group G consider the following four 
conditions. 

(Cl) There is an orbit-equivalent action of some group G' which has non-trivial principal 

isotropy groups. 
(C2) The representation has non-trivial copolarity. 
(C3) The action has a non-trivial reduction. 
(C4) The quotient V/G has non-empty boundary. 

We have implications (Cl) =>■ (C2) =>• (C3) =>■ (C4). We do not know a single representa- 
tion which satisfies (C3) but not (Cl) and only very few representations of connected groups 
satisfying (C4) but not (Cl). Are there some reverse implications? 

For all representations appearing in our main results the conditions (Cl), (C2) and (C3) 
are equivalent. We formulate a special case of this observation that follows directly from the 
proofs of the main theorems: 

Corollary 1.5. Let p be an irreducible representation of a connected compact Lie group. If 
the cohomogeneity is at most 5 or the abstract copolarity is at most 6, then the copolarity of 
the representation coincides with its abstract copolarity. 

1.5. Structure. The paper is divided into two parts. In the first part we study the geometry 
of reductions and prove Theorems [TJTJ and [T72J After a section on preliminaries, we investigate 
orbifold parts of quotient spaces in Section [3j We use orbifold fundamental groups to reduce 
the investigation of quotient equivalent actions of on Mj, i = 1, 2, to the case where 
Gi/G® acts on the subquotient M^/G° as a reflection group (Proposition 13. 2p . Moreover, we 

4 



find an easy criterion when one can replace one of the groups Gi by its identity component 
(Proposition 13.11) . In Section H] we study the restrictions imposed by the triviality of the 
principal isotropy groups on the strata of low codimensions. In Section [5j we specialize 
to representations and prove some basic structural results: the invariance of irreducibility 
(Lemma l5.ip and the necessity of boundaries for the existence of reductions (Proposition 
The results from these preparatory sections may be useful for other related problems as well. 

In Section [HI the technical heart of the paper, we study irreducible representations whose 
restricted representations to the identity component are reducible and prove Proposition 16. 1[ 
where our special representations of maximal tori T k of SU(fc + 1) turn up. In Section [7] 
we apply results of Sections [31 @] and 0, to study the geometry of C k+1 /T h . In Section [HI 
we collect the harvest and prove Theorem 11.21 In Section O we start with the proof of 
Theorem 11.11 which is finished in the two subsequent sections, dealing with the cases of 
connected, respectively, disconnected minimal reduction of our original presentation. 

In the final part of the proof of Theorem 11.21 as well as of Theorem 11.11 a few cases that 
we cannot resolve by direct geometric arguments show up. To exclude these few possible 
reductions, we rely on the classification of irreducible representations of low cohomogeneity 
(Theorem II .4p . This theorem is proved independently in the second part of the paper, by 
invoking classifications of representations of simple groups with low cohomogeneity, followed 
by a straightforward but a bit tedious analysis of tensor products of representations. In the 
last section we discuss copolarities of the found representations. 

Part 1. Geometry of reductions 

2. Preliminaries 

In this section we collect a few basic results about actions of a compact group of isome- 
tries G on a connected complete Riemannian manifold M. We assume that the actions are 
effective. In the later sections, M will always be either an Euclidean space or an Euclidean 
sphere. Let X be the quotient space M/G with the induced quotient metric. 

2.1. Stratification. For a point p G M we denote by G p its isotropy group, and we denote 
by St(p) the stratum of p, i.e., the connected component through p of the set of points q G M 
whose isotropy groups G q are conjugate to G p . 

Denote by x the image point x = G ■ p G X . The stratum St(p) is a manifold and projects 
to a Riemannian totally geodesic submanifold Stx{x) of the space X, called a stratum of X. 

The dimension of the stratum St(p) coincides with the topological dimension of dim(G--F), 
where F is the connected component through p of the set of fixed points of G p . We have 
dim(G ■ F) — fp + g — n p , where f p is the dimension of F, where g is the dimension of G and 
n p is the dimension of the normalizer N(G P ) of G p in G. 

Locally at a point p G M, the orbit decomposition of M is completely determined by the 
slice representation of the isotropy group G p on the normal space % p := N P {G ■ p) to the 
orbit G ■ p. According to our convention St(p) is connected, therefore the equivalence class 
of the slice representation along St(p) is constant. The set of fixed vectors of G p in % p is 
tangent to the stratum St(p), and the action of G p on its orthogonal complement % P in % p 
has cohomogeneity dim("Hj/G p ), which equals to the codimension of the stratum St x (x) in 
X, where x = G ■ p. 
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A point pG Mis called regular if lO p is trivial. It is called exceptional if it is not regular 
and the action of G p on lO p has discrete orbits. If it is neither regular nor exceptional, it is 
called singular. The set M reg of all regular points in M is open and dense, and X reg = M reg /G 
is connected. X reg is the stratum corresponding to the unique conjugacy class of minimal 
appearing isotropy groups. These isotropy groups are called the principal isotropy groups. 

2.2. Boundary. The set X reg of regular points of X is exactly the set of points that have 
neighborhoods isometric to Riemannian manifolds. It is the unique maximally dimensional 
stratum in X. By definition, the boundary of X is the closure of union of all strata that 
have codimension 1 in X. It is denoted by dX. A point p G M is mapped to a stratum of 
codimension 1 in X if and only if the isotropy group G p acts on W p with co homogeneity 1. 
Since boundary points will play a special role in subsequent considerations, we are going to 
call a point p£M that projects to a point on a stratum of codimension 1 in X an important 
point, or, if the action needs to be specified, a G-important point. 

Let now G' be a normal subgroup of G, with finite quotient T = G/G'. Then T acts 
by isometries on X' := M/G', and X = X'/T. Since X and X' have the same dimension, 
and since strata of X' are mapped to unions of strata of X, we have 7r(dX') C dX. Here, 
7r : X' — > X is the canonical projection. On the other hand, any G-important point p that is 
not G'-important must be G'-regular. In this case, we deduce that G p /G' p must act on the 
normal space H p as a single reflection at a hyperplane in H p . 

2.3. Copolarity and polar actions. We refer to |GOT04j for a detailed discussion of the 
following notions. A generalized section of the action of G on M is a connected complete 
totally geodesic submanifold E whose intersection £ n M reg with the set of regular points is 
not empty and satisfies H p C T p £ for any p G £ fl M reg . For any minimal generalized section 
E, the group Gs = {g G G|g£ = £} acts on £ and the canonical map £/Gs — > M/G is 
an isometry. The minimal dimension of such Gs is called the copolarity of the action. In 
addition, we say that the copolarity of the action of G on M is non-trivial if £ ^ M, i.e., 
if G s + G. 

If the action of G on M has non-trivial principal isotropy groups then a connected com- 
ponent containing regular points of the set of fixed points of any principal isotropy group is 
a generalized section. Thus such an action has non-trivial copolarity. 

An action of another compact Lie group G' by isometries on another connected complete 
Riemannian manifold M' is called orbit- equivalent to the action of G on M if both actions 
have the same orbits, up to isometry. More precisely, they are orbit-equivalent if there exists 
an isometry F : M — > M' such that F(G(p)) = G'(F(p)) for every p G M. In this case, 
we can identify M and M' via F and view G and G' as subgroups of the isometry group of 
M. If G' does not coincide with G inside the isometry group of M then the group generated 
by G and G' is also orbit equivalent to both actions and has non-trivial principal isotropy 
groups. Thus this group and therefore the actions of G and G' have non-trivial copolarity 
in this case. 

An action is called polar if it has copolarity 0, i.e., if and only if it admits a generalized 
section £ with dim(£) = dim M/G (in which case £ is called a section of the action). 

If M is a Euclidean space V, then by the above, any non-trivial generalized section defines 
a reduction. Thus the abstract copolarity is bounded above by the copolarity. 

It is known that an orthogonal representation G on V is polar if and only if it is orbit 
equivalent to the isotropy representation of a symmetric space [Dad85] . Another equivalent 
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formulation is that the set of regular points X reg of X is flat |HLO06t IAle 06j. Therefore, if a 
representation has a reduction to a discrete group, it must be polar. Thus a representation 
has abstract copolarity if and only if it has copolarity 0. 

The classification result of |Str94j implies, in terms of copolarity, that any representation 



of cohomogeneity at most 3 has copolarity at most 1. 

3. Reflections in quotients 

3.1. Formulation. Given two isometric quotients M\jG\ and M2/G2 of Riemannian man- 
ifolds modulo compact groups of isometries, one would like to replace the groups by some 
smaller subgroups of finite index (for instance, by the identity components) preserving the 
property of having isometric quotients. In this section we are going to prove two useful 
criterions for such reductions. The first one is quite general: 

Proposition 3.1. Let M\, M 2 be simply connected Riemannian manifolds. Let Gi be a com- 
pact group of isometries of Mi, for i = 1,2. Assume that M\jG\ and M2/G2 are isometric. 
If the quotient M\/G\ has no boundary, then for any subgroup G' 2 of finite index in G2 there 
is a subgroup G[ of finite index in G± such that M2/G2 = M\jG\. 

To formulate our criterion in the presence of boundaries we need a definition. A reflection 
on a Riemannian manifold is an isometry whose set of fixed points has codimension 1. Let 
X = Mj G be a quotient space. An isometry of X is called a reflection on X if its restriction 
to the regular part X reg is a reflection. A discrete group of isometries of X that is generated 
by reflections is called a reflection group on X. We refer to |DAM07j for more about reflection 
groups on manifolds. 

The second result of this section is the following: 

Proposition 3.2. Let Gi be a compact group of isometries of a simply connected Riemannian 
manifold Mi for i — 1,2. Assume that M\jG\ and M 2 /G 2 are isometric. Then there are 
normal subgroups of finite index Gf in Gi such that the group Gf jG\ acts on the quotient 
MijG\ as a reflection group, i = 1, 2, and Mi/Gf and M 2 /Gf are isometric. In particular 
if, say, Gi is connected, we can take Gf = Gi for i = 1, 2 and then G2/G2 acts on M 2 /G9, 
as a reflection group. 

To prove the results we are going to study more closely a slightly larger part of the quotient 
X than X reg , its orbifold part X or i,. 

3.2. Riemannian orbifolds and their fundamental groups. We are going to use a 
bit about orbifolds and orbifold fundamental groups. We refer the reader to the notes by 
Thurston [Thu80] and to those by Davis [DavlOj . 

A Riemannian orbifold is a metric space C where each point has a neighborhood isometric 
to a finite quotient of a smooth Riemannian manifold. Since it is locally represented as a 
quotient in a unique manner, it comes along with a natural stratification and a unique 
underlying structure of a smooth orbifold. 

Let C be a connected Riemannian orbifold. Let 7r° rb (C) denote the orbifold fundamental 
group of C (cf. |Davl0j ). This group acts as a group of discrete isometries on a connected 
Riemannian orbifold C, called the universal orbifold covering of C, such that C/iT° rb (C) = 
C. For any other presentation of the orbifold C as a quotient C = B/Y of a connected 
Riemannian orbifold B modulo a discrete group of isometries T, there is an (essentially 
unique) normal subgroup T' of 7i° rb (C), such that C/V = B and such that T = 7i° rb (C)/r' . 

7 



A Riemannian orbifold C has a trivial orbifold fundamental group if and only if it coincides 
with its universal orbifold covering C. In this case C has no boundary and it is simply 
connected as a topological space. In general, one can write a presentation of the orbifold 
fundamental group of C in terms of its usual fundamental group and its strata of codimension 
1 and 2 [DavlOj. Looking at this presentation of the orbifold fundamental group one notes 
that the embedding C \ dC -> C induces an injection Ti° rb (C \ dC) -> 7rf 6 (C). 

If ir° rb (C \ dC) = 1 (essentially, the only case that will be of importance in the sequel, see 
Lemma 1375]) then the presentation of 7r° rb (C) has the following simple form. For any stratum 
£ of codimension one in C one takes a generator that has by definition order 2. Whenever 
codimension one strata Ei, S 2 meet at a stratum P of codimension 2, (i.e. P C £i fl £2) one 
adds a relation • ws 2 ) m ' P ' = 1, where m(P) is the natural number defined such Si and 
S 2 meet at P at the angle ir/m(P). In particular, 7r° rb (C) is a Coxeter group. If all occuring 
angles n/m(P) are equal to tt/2, then the group 7r° r6 (C) must be Abelian or infinite. 

3.3. Reflections in orbifolds. Let C be a connected Riemannian orbifold. For a discrete 
group T of isometries of C we denote by T re fi the subgroup of T that is generated by 
reflections of C that are contained in T. Since a conjugate of a reflection is a reflection, r re ^ 
is a normal subgroup of T. 

The following lemma will provide us with sufficiently many reflections: 

Lemma 3.3. Let B be a Riemannian orbifold. Let T be a discrete group of isometries of B. 
Let C be the orbifold C = B/T. Set C = C \ dC . If the orbifold fundamental group of C 
is trivial, then T is a reflection group on B. 

Proof. Denote by T' the quotient group T' = T/T re fi. Then r" acts by isometries on B' := 
B/T re fi such that B'/T' = C. If an element w in T' acts as a reflection on B', then we can 
find a manifold point p in B that is projected to a manifold point in B', but whose projection 
to C lies on a stratum of codimension 1 in C . Thus this point p must be fixed by a reflection 
in T that is not in T re fi, providing a contradiction. 

Hence T' does not contain reflections of B' . Therefore, the projection B' — > C has the 
property that the preimage of a boundary point in C is a boundary point in B' . Hence the 
preimage of Cq is exactly B' = B' \ d(B'), i.e., a connected orbifold. Hence Co = B' /V. 
Since 7i° rb (Co) = 1, the group T' acts trivially on B' . Thus T = T re fi. □ 

Consider now the action of ir° rb (C) on the universal covering C of C. We obtain the 
reflection group 7r° rfe (C) re // =: ^r e fi(C) of isometries of C. The quotient C /ir^ e fi(C) is a 
Riemannian orbifold, which will be denoted by C re /i • The quotient group ^nonrefii^) := 
n° rb (C)/n?X fl (C) acts on C refl with C refl /^ b onr e f i(C) = C. By construction, C refl is the 
unique minimal orbifold covering of C with property that its orbifold fundamental group is 
generated by reflections. 

The following observation is probably well known to the experts. We include it here with 
a sketchy proof for the sake of completeness: 

Proposition 3.4. In the notations above we have ^nonrefii^) = ^^(C \ dC). Thus for 
any Riemannian orbifold there is a split exact sequence: 

1 -> <X fl (c) -»• K r \c) -> < fe (C \dC)^l 
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Proof. The proof of Lemma [331 shows that K°^ onre fi{C) does not contain reflections of C re fi. 
Moreover, for the projection from C re fi to C, the preimage of C \ dC is the connected 
Riemannian orbifold C re fi \ dC re fi . 

Now, by definition, the orbifold fundamental group of C re fi is generated by reflections. 
Looking at the presentation of the orbifold fundamental group in terms of the strata [DavlOj, 
one deduces that C re /z \ dC re fi has trivial orbifold fundamental group. Hence ^nonrefii^) 
acts on the simply connected orbifold C re fi \ dC re fi with quotient orbifold identified with 
C \ dC . This implies the result. □ 

3.4. Orbifold points in quotients. We call a point x in our quotient X = M/G an 
orbifold point if it has a neighborhood isometric to a Riemannian orbifold. It has been 
shown in |LT10j that a point p G M is projected to an orbifold point in X if and only if 
the slice representation of G p on Hp is polar. The orbifold X or b of all orbifold points in X is 
open, connected and it is a union of strata. It contains all strata that have codimension at 
most 2 in X, in particular, all G-important orbits. The set X or b has a non-empty boundary 
if and only if X has non-empty boundary. 

The following result, probably folklore, can be found in |LytlO| : 

Lemma 3.5. Let M be a simply connected complete Riemannian manifold. Let G be a 
connected compact group of isometries of M. Let X be the quotient M/G. Let X or b be 
the set of orbifold points in X and set X = X or t> \ dX or b- Then X is exactly the set of 
non-singular G-orbits. Moreover, Xq has trivial orbifold fundamental group. 

In particular, the above lemma says, that if M is simply connected and G connected, no 
G- important point may lie on an exceptional orbit. 

The open subsets X reg and X or b are dense and convex in the quotient space X. Thus 
for a pair of quotients X = M/G and Y = N/H any isometry between X or b and Y OT b (or 
between X reg and Y reg ) extends uniquely to an isometry between their completions X and Y. 

Consider again the quotient X = M/G. If G' is a subgroup of finite index in G then 
7i(X' orb ) = X or b, where X' = M/G' and 7r : X' — > X is the canonical projection. 

Let X° be the subquotient M/G°. Consider the orbifold parts X orb and X^ rb . The group 
G acts on X® rb by isometries and we obtain a homomorphism j from G/G° onto a finite 
group D of isometries of X^ rb , such that X orb = X^ rb /D. Thus for the orbifold fundamental 
groups T = ii° rb (X or b) and r = n° rb (X® rb ), the group r is a normal subgroup of T with 

i) r To. 

Any subgroup G' of finite index in G has a subquotient X' = M/G' such that the orbifold 
fundamental group of X' orb is contained in -Kl rb (X orb ) and contains 7rf 6 (X° r6 ). On the other 
hand, any group V with r C V C V projects to a subgroup of D. Taking the preimage of 
this subgroup under j in G we obtain a subgroup G' of finite index in G. Then the orbifold 
part X' orb of the quotient X' = M/G' has T' as its orbifold fundamental group. 

Now we are in position to prove the main results of this section. 

Proof of Proposition^^ Set X = M x /G x = M 2 /G 2 . By assumption, X° = M 1 /G Q 1 has 
no boundary. Hence X^ rb has trivial orbifold fundamental group by Lemma 13.51 Consider 
the orbifold covering X' orb = (M2/G' 2 ) rb of X or b defined by the subgroup G' 2 of G 2 - Since 
7r° r ' 6 (X° rb ) = 1, using considerations preceding the proof, we find a subgroup G[ of G\ such 
that (MjG'Jorb = X' orb . ' □ 
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Proof of Proposition\EE Let X = M1/G1 = M 2 /G 2 and consider the orbifolds (Mi/G°) orf > 
for i — 1, 2. We deduce from Lemma [331 and Lemma [3731 that P = n° rb ((Mi/G®) or b) is 
generated by reflections. Consider now the subgroup T re f t of T = 7i° rb (X orb ) that is generated 
by all reflections in T. Then T re fi contains P, hence due to the considerations above, we 
find subgroups of finite index Gf in Gj such that (Mi/Gf) or b is isometric to (X orb ) re ji, i.e., 
to the quotient of the universal orbifold covering of X orb modulo T re fi. Hence Mi/Gf for 
i = 1, 2 are isometric. 

Since T re f t is generated by reflections on the universal orbifold covering of X orb , the group 
Y re fi/Y l acts as a reflection group on (Mi/G®) orb . □ 

4. Triviality of the principal isotropy group 

4.1. Boundary points. Let the compact group G act (effectively) on the simply connected 
manifold M with trivial principal isotropy groups. Then the principal isotropy group of any 
slice representation is trivial as well. If p G M is a G-important point then the isotropy group 
G p must act transitively on the unit sphere S a in 'Hp', the normal space to the stratum St(p). 
Since the action must have trivial principal isotropy as well, G p must be diffeomorphic to S a . 
But this can happen only for a = 0, 1 or 3. Note that if a = 1 or 3, then G p is contained 
in the identity component G° of G and p is G°-important. On the other hand, if p is a 
G°-important point, then it cannot lie on an G°-exceptional orbit, due to Lemma [3.51 Thus 
Gp must be non-discrete and a ^ in this case. 

Hence p is G-important and not G°-important if and only if G p is a group with only one 
non-trivial element w. This element w is an involution in G \ G° which normalizes G°. 
Moreover, it acts as a reflection on M/G°. 

Summarizing and using Subsection 12. II we arrive at: 

Lemma 4.1. Let the compact group G with identity component G° act effectively on a 
simply connected manifold M. Assume that the principal isotropy group of G is trivial. 
If a point p is G -important, then G p = S a , for a equal to 0, 1 or 3. We have a = if 
and only if p is not G° '-important. Moreover the stratum St(p) through p has dimension 
dim St(p) = dim(M) — a — 1 = f p + g — n p , where f p denotes the dimension of the connected 
component of the set of fixed points of G p , g is the dimension of G and n p is the dimension 
of the normalizer of G p in G. 

4.2. Codimension two strata. Let a connected compact group G act on a simply con- 
nected manifold M with trivial principal isotropy group. Let X be the quotient M/G, and 
let x be a point in a stratum of codimension two in X. Then x G X orb . If x is not contained 
in the boundary dX it must be an exceptional orbit of the G-action (Lemma l3.5l) . Otherwise, 
x G dX. Take a point p in the G-orbit corresponding to x. Then the tangent cone C X X at 
x to X is isometric to the quotient % P /G P of the slice representation. The assumption that 
x lies in a stratum of codimension two implies that G p fixes a subspace H k ~ 2 of Hp and acts 
on the orthogonal complement l-0 p with codimension two. 

The representation of (G p )° on 1-0 is of cohomogeneity two and the quotient T-0/{G p ) Q 
is isometric to H 2 /D m , where D m is the dihedral group of order 2m that is generated by 
two reflections at lines enclosing the angle ir/m. The classification of representations of 
cohomogeneity two [HL71j implies that m can be only 2, 3, 4 or 6 (much more sophisticated 
topological argument is given in |Miin81j ). Moreover, the classification shows that the action 
of (G p )° on Hp has non-trivial principal isotropy groups, possibly unless if m = 2. If the 
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action of (G p )° has non-trivial principal isotropy, so does the action of G. Thus T-L P /{G P ) is 
isometric to R fc ~ 2 x K 2 /D 2 . 

We claim that the action of G p on ~H p is orbit-equivalent to the action of (G p )°. Otherwise, 
G p j (Gp}° acts as a non-trivial group of isometries on w v j (G p )°. However, the only non-trivial 
isometry of the quadrant H 2 /D 2 is the reflection at the midline of the quadrant. Any non- 
zero small vector v G % p in the preimage of this line is G p - important and (G p )°- regular. 
Exponentiating v, we find a point p' in M close to p that is G-important and lies on an 
exceptional orbit. This contradicts Lemma [3.51 

Thus, we have shown that the tangent cone C X X is isometric to R fc ~ 2 x H 2 /D 2 . But this 
means that the two strata of codimension 1, whose closures contain the point x, meet at the 
point a; at a right angle. 

Lemma 4.2. Let a connected compact Lie group G act isometrically on a simply connected 
manifold M. Assume that the principal isotropy groups of the action are trivial. Then 
codimension 1 strata of X = M/G can only meet at a right angle, i.e., for any point x in a 
stratum of codimension two in X which is contained in the boundary, the tangent cone C X X 
at x is isometric to R fc_2 x R 2 /_D 2 . Here, D 2 is the dihedral group of order 4 generated by 
reflections at two orthogonal lines. 

4.3. Nice involutions. Assume now that a (possibly disconnected) group G acts on Rie- 
mannian manifold M with trivial principal isotropy group. Assume moreover that V = G/G° 
acts on M/G° as a reflection group. Since the action has trivial principal isotropy groups, 
the action of T on M/G° is effective. By definition, the group T is generated by elements 
w' G G that act on the quotient M/G° as reflections. Given any w' G G that acts on 
M/G° as a reflection, we take a regular point x G M/G° that is fixed by w'. Let p 
be a preimage of x in M. Then p is G°-regular and G-important. Thus G p contains 
only one non-trivial element w, equal to w'g, for some g G G°. This element w is an 
involution and the connected component F through p of its set of fixed points satisfies 
dim(G • F) = dim(F) + dim(G) — dim(C) = dim(M) — 1, where C is the centralizer of w 
(hence the normalizer of G p ) in G. Since w and w' are equivalent modulo G°, involutions of 
the kind of w generate T; we will call them nice involutions. 

5. Basic observations 

In this section we collect some basic observations about quotient-equivalences. For a 
Euclidean space U, we will denote by S(U) the unit sphere of U. 

5.1. Fixed points and origins. Let U be a Euclidean space and let K be a nontrivial 
closed subgroup of 0{U). Let F be the set of fixed points of K, and let F 1 - be its orthogonal 
complement. Then X = U/K splits as Fx (F /K). Moreover, for any unit vector v in 
U\F there is no unit vector v' in U with d(K ■ v, v') = 2. Thus there is no geodesic in U/K 
that starts in K ■ v and has the origin K • = Ou as its midpoint. Thus F contains the set 
of all lines through the origin. In particular, it is the unique maximal Euclidean factor of 
U/K. 

On the other hand, in the factor F L /K the origin Ojj is the only point that is not the 
midpoint of some geodesic (all other points lie on the ray that starts at Of/). 

Therefore, for any other representation of a group K' on an Euclidean space U', any 
isometry I : U/K —> U'/K' must be given as a product of isometries I\ : F — > F' and 
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I<i : F ± /K — > (F') ± /K'. Moreover, the second isometry I2 must send the origin to the 
origin. 

Changing our isometry / by an isometry of the Euclidean space F, if needed, we may 
therefore assume that I sends the origin Ojj to the origin Ojj'- From now on we will make 
this assumption. 

Since the quotient of the unit spheres S{U)/K is just the unit distance sphere in the 
quotient, our isometry I induces an isometry between the spherical quotients I : S(U)/K — > 
S{U')/K'. 

If the set of fixed points F is non-trivial, then S(U)/K has diameter tt. On the other 
hand, assume that the diameter of S(U)/K is larger than tt/2. Then, for some orbit K ■ v of 
a unit vector v , the set of points in the unit sphere with distance > tt/2 + e to this orbit is 
non-empty, for some positive e. But this set is compact, convex, i^-invariant and does not 
contain great circles. Hence it has a unique center which must be fixed by K. 

Thus we see that the action has non-zero fixed points if and only if the diameter of S(U) / K 
is larger than tt/2 (in which case it is equal to tt). 

5.2. Invar iance of reducibility. We want to prove that invariant subspaces can be recog- 
nized metrically and thus are invariants of the quotient-equivalence classes. 

Thus let K act on U as above. Consider the restricted action on the sphere S(U) with 
quotient X = S{U)/K. Assume that there are no fixed points of K in S{U). 

We claim that a closed subset Z G X has the form S(V)/K for some .fT-invariant subspace 
V if and only if there is some Z' C X such that Z is the set of all points z e X with 
d(z, z') = tt/2, for all z' e Z'. 

Namely, if Z = S(V)/K where V is if- invariant, one can consider its orthogonal comple- 
ment V 1 - and set Z' := S{V L )/K. On the other hand, if Z G X is given in terms of Z' 
as above, then the preimage of Z in S(U) is a compact convex K- invariant subset of S(U). 
Since K does not have fixed points in U, this subset must be a great subsphere of S(U). 
Thus it is the unit sphere of a i^-invariant subspace. 

This provides a metric description of projections of invariant subspaces under the assump- 
tion of the absence of fixed points. Combining it with the previous subsection we arrive 
at: 

Lemma 5.1. Let p : K — )■ 0(U) and p' : K' — > 0(U') be quotient- equivalent representations , 
with projections tt : U — )■ U/K and tt' : U' — > U'/K'. Then p is irreducible if and only if 
p' is. More precisely, if I : U/K — >■ U'/K 1 is an (origin preserving) isometry then for any 
K-invariant subspace V of U the subset 7r'~ 1 (/(7r(V r ))) is a K' -invariant subspace ofU'. 

5.3. Existence of boundary points. Given a representation of p : G — > O(V) of a group 
G, the copolarity of G and of its identity component G° coincide |GOT04j . On the other 
hand, the corresponding statement about the abstract copolarity is not clear to us. The 
following lemma, which is most basic to our results, is formulated in terms of the identity 
component. In view of this lemma, it seems that the abstract copolarity of the representation 
may always coincide with that of the identity component. 

Proposition 5.2. Let p : G — > O(V) be an effective representation and let G° be the identity 
component of G. If Xq = V/G° has an empty boundary then the representation p is reduced. 

Proof. Assume that the boundary of X Q is empty and assume that X = V/G is isometric to 
W/H, for a representation of a group H on W with dimfW) < dim(y). 
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The "unit sphere" Yq in Xq, i.e., the distance sphere to the orbit of the origin, is isometric 
to S(V)/G°. Since Xq is the Euclidean cone over Yq, the quotient Y does not have boundary 
as well. The unit sphere Y of X is isometric to S(V)/G and to S(W)/H. By construction, 
Y is a finite quotient Y = Y /T, for T = G/G°. 

Since Yq has no strata of codimension 1, we find an infinite geodesic in Yq that is contained 
in the set of G°-regular orbits and starts at a point y G Y , such that y is projected to a 
regular point in Y. Take a part 7 of this geodesic that has length tt. Let m be the index of 
this geodesic (i.e., the number of conjugate points along 7, counted with multiplicites). For 
the Riemannian submersion S(V) reg — > {Yo) reg , consider any horizontal lift rj of 7. Then the 
index m of 7 is equal to the L-index of 7] (i.e. the number of L-focal points along rj), where 
L is the G°-orbit corresponding to the point y, and where rj is considered as an L-geodesic. 
But in the round sphere S(V), the L-index of any L-geodesic rj of length 7r is exactly the 
dimension of L. Thus m = dim(L) in this case. 

Consider now the image 7' of 7 in Y. It is contained in the orbifold part of Y and is (by 
definition) an orbifold geodesic that starts at a regular point. Consider a lift rj of 7' to an H- 
horizontal geodesic in S(W) that starts on a regular H -orbit L'. It has been shown in |LT10j 
that the L'-index of the geodesic rf is equal to the sum of the index of the orbifold-geodesic 
7' and a "vertical index" , a non-negative number that counts the number of intersection of 
rj' with LLsingular orbits. In particular, it is not smaller than m, the index of the orbifold- 
geodesic 7'. Using again that the L'-index of rj' is given by the dimension of V , we get 
dim(L') > m. 

But this contradicts dim(V) = dim(X) + dim(L) > dim(VK) = dim(X) + dim(L'). □ 

Remark 5.1. Applying Wilking's transversal Jacobi equation [Wil07t Cor. 10], one can deduce 
in a similar way the following related statement. Let a compact group G act on a compact 
positively curved manifold M. If the quotient M/G° has no boundary then the action has 
trivial copolarity. 

6. Main argument 
In this section we are going to prove the following result: 

Proposition 6.1. Let a non-discrete group G act with trivial copolarity on a Euclidean 
vector space V . Assume that G/G° acts on V/G° as a reflection group. Assume also that G 
acts irreducibly but that the action of G° is reducible. Then either the action of G° on V 
can be identified with the action of the maximal torus of SU(n) on C n , or G° is one of the 
groups U(2) or U(l) ■ Sp(2) and V is the double of the vector representation (on C 2 or H 2 ; 
respectively). 

6.1. Basic lemma. Since the representation has trivial copolarity, it has trivial principal 
isotropy group. Thus G/Gq is generated by nice involutions in terms of Subsection 14.31 
Since G° is normal in G, any element of G sends a G°-irreducible subspace to another G°- 
irreducible subspace. Thus we obtain an action of the finite group T := G/G° on the set of 
G°-isotypical components and on the set of G°-irreducible subspaces. 

Recall that, by assumption, our group G has positive dimension. Since its representation 
on V has trivial copolarity, it is not polar. 

The basic step is the following observation: 
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Lemma 6.2. Under our general assumptions, let U±\ be G^ -invariant subspaces with U\ D 
U-i = {0}. Let w G G be a nice involution that satisfies w(U-\) = U\. Then the action of 
G° on U±i is of cohomogeneity 1. 

Proof. Denote by F the subspace of fixed points of w in V. By Subsection 14.31 the subset 
G-F must be of codimension 1 in V. In particular, the subset G -Fq must be of codimension 
1 in U\ © U-i, where F is the space of all (u + w(u)) for u G U\. However, G° ■ F Q is an 
algebraic set that is contained in the subspace A of all u + v G U\ © £7_i with |w| = |i>|. 
Hence, G° • Fq contains an open subset of A. 

Thus, for some unit u G U% and all v in an open subset of the unit sphere of U-\ there is 
some u' G U\ and h G G° with /m/ = u and /«W = v. In particular, we have hwh~ 1 u = v, 
thus (whw)h~ 1 u = wv. Hence, the orbit G°u contains an open subset of the unit sphere in 
JJ\. If dimf/x > 2, then G° acts transitively on the unit sphere in U\. If dim(C/x) = 1, the 
statement is clear anyway. □ 

6.2. Isotypical components. Recall that the action of G on V is irreducible. Hence the 
action of T = G/G° on the set of G°-isotypical components is transitive. From this and 
Lemma [6.21 we derive: 

Lemma 6.3. Under the assumptions above, let V — V\ © • • • © V\ be the decomposition of 
V into G° '-isotypical components, and assume that I > 1. Then the action of G° on each Vi 
is of cohomogeneity 1; in particular, each Vi is G° -irreducible. The group T acts on the set 
S = {Vi, . . . , Vi} of G° -isotypical components as the full permutation group. 

Proof. If there is a trivial G°-isotypical component, then from the transitivity of the action 
of T, we deduce that all isotypical components are trivial. Since the action of G is effective, 
we would get that G is discrete, in contradiction to our assumption. 

The group V is generated by nice involutions. Since the action of V on S is transitive, for 
any Vi, we find a nice involution w G G which moves Vi to some Vj ^ Vi. We use Lemma I6\2l 
to see that the action of G on has cohomogeneity 1. 

We claim that such w leaves all other Vk, k ^ i, j invariant. Otherwise, we could set 
U-i := Vi®Vk in Lemma [6T21 and obtain that G° acts with cohomogeneity 1 on ViQ)Vk, which is 
impossible. Thus the action of the group T on the finite set S is generated by transpositions. 
Since it is also transitive, the image of T must be the full group of permutations of S. □ 

In the same way we are going to deduce: 

Lemma 6.4. Assume that there is only one G° -isotypical component. Then the action of 
G° on each G° -irreducible subspace of V is of cohomogeneity 1. Moreover, there is a nice 
involution w G G and a decomposition ofV = V\ © • • • © Vi into G° -irreducible subspaces Vi 
such that w(Vi) = V 2 and w(Vi) = Vi, for all i > 3. 

Proof. Take a G°-irreducible subspace V\. Since V\ is not G-invariant, some element of T 
moves V\ to another G°-irreducible subspace. We find a nice involution w G G that does 
not leave V\ invariant. We may apply Lemma 16.21 and deduce that the action of G° on 
V\ and hence on any G°-irreducible subspace has cohomogeneity 1. Set V 2 = w(Vi) and 
choose pairwise orthogonal G°-invariant subspaces V3, . . . , V that are orthogonal to V\, Vi 
and satisfy V = V\ © • • • © V\. By the same argument as in the proof of Lemma 16.31 we 
deduce that w must leave the Vi, i > 3, invariant. □ 
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6.3. Hopf action and its brothers. In this subsection we are going to analyze the case 
of one iso typical component. We start with the following simple observation: 

Lemma 6.5. Let a connected group K act effectively with cohomogeneity 1 on a vector 
space U. If the doubling representation of K on U @U has trivial copolarity then K is one 
of the classical groups U(l), SU(2) = Sp(l), U(2), Sp(2), U(l) • Sp(2) with its vector 
representation on U = C ; C 2 = H ; C 2 , H 2 , H 2 , respectively. 

Proof. The representations of cohomogeneity 1 are listed in Subsection 112.71 Going through 
the list, one observes that if K acts on U © U with trivial principal isotropy group then K 
is either one of the groups above, or K = SO (3), or K = SU(3). 

However, the action of SO(3) (resp. SU(3)) on R 3 ©R 3 (resp. C 3 ©C 3 ) is orbit equivalent 
to the action of 0(3) (resp. U(3)). Thus it has non-trivial copolarity. □ 

Proposition 6.6. Under the general assumptions of this section, assume that there is only 
one G Q -isotypical component in V . Then G° is one of the groups U(l), U(2), U(l) • Sp(2) ; 
V — Vi V 2 , and V\, V 2 are the vector representations of G° , i.e., C, C 2 , H 2 , respectively. 

Proof. Consider an involution w in G and a decomposition V = V\ © • • • © Vi into G°- 
irreducible subspaces, as in Lemma 16.41 Since G acts effectively, the assumption that there 
is only one isotypical component implies that G° acts effectively on V±. We identify G° with 
its image in SO(Vi) and recall that it acts on V\ with cohomogeneity 1. Since there is only 
one isotypical component, we fix (G°-equivariant) identifications of Vi with V\ for all i. 

We write elements in V as (t>i, . . . ,v{), for Vi G Vi = V\. Then the action of G° on V is 
given in these coordinates by g • (vi, . . . , v{) = (g ■ vi, . . . , g ■ Vi). Moreover, by assumption, 
there are isometries p±, . . . ,pi : V± — > V\ such that the action of w is given by 

W(V 1} ...,V t ) = (P2(v 2 ),pi(v 1 ),p 3 (v 3 ), . . .,Pi(v t )). 

Since w is an involution, we have p 2 = p^ 1 and pf = 1, for i > 3. We set p = p\. For an 
element g G G°, the conjugation g w = w~ l gw acts as 

g w (v u ...,v{) = {g p {vi),g p ~\v 2 ),g pz {vz)i g Vl {v{)). 

By assumption, w normalizes G°. Thus we must have g p = g p 1 = g Pi , for all i > 3. And 
this element g p is contained in G . Denoting by iV and C the normalizer and the centralizer 
of G° in O(Vi), we deduce: p, pi <E N and p 2 , pp~ x G C for i > 3. 

Let F be the subspace of fixed points of w in V. It consists of all elements of the form 

(«l,J?(«l),/3, •• 

where Vi G V\ is arbitrary and fi G V\ is fixed by pi. Since if is a nice involution, the set 
S = G° ■ F is of codimension 1 in V. 

First, assume I > 3. Then there is some c G C with p = c ■ p%. Thus any element 
(ui, . . . ,U[) G S has the first three coordinates given by (u±, u 2 , W3) = (g (v) , g (c- p 3 (v)) , g(f 3 )) , 
for some g G G , some v G V% and some ^3 G V\ fixed by the involution p 3 . 

Hence we have |wi| = \u 2 \ and (u 2 — c(ui)) _L c{u 3 ). The assumption dim5 = dimV^ — 1 
implies u 2 = c(ui), and, therefore, dim(Vi) = 1. Then G is discrete in contradiction to our 
assumption. We deduce I < 2, so I = 2. 

Using Lemma 16.51 and our assumption that G acts with trivial copolarity, we deduce that 
if the lemma does not hold, then G° = Sp(m) for m = 1 or m = 2 and V\ = H m . Thus we 
only need to exclude these two cases. 
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Under the assumption I = 2, we have 

S = G° ■ F = {(vy(v)) \geG°,ve V 1 }. 

We have 

(p 9 (v),v) = m 2 (v),f(v)) = {(p 2 Y(v)y(v)) = (f(v),p 2 (v)), 

since p 2 G C . Thus all elements (ui, U2) in S satisfy \ui\ = \u2\ and w 2 _L (u\ — p 2 {ui)). Since 
S has codimension 1, we deduce that p 2 must be the identity. 

Let now c be an arbitrary element in C. Then cp G N and (cp) 2 = c(pcp~ 1 )p 2 G C . The 
same calculation as above reveals, (cp) g {v ) _L (u — (cp) 2 (v)), hence p 9 {v ) _L c _1 (i; — (cp) 2 (u)). 
Again the assumption that S has codimension 1 implies that (cp) 2 is the identity Thus we 
have shown that for all c G C the equality (cp) 2 = 1 must hold. 

If now G° = Sp(m) then its normalizer is N = Sp(m) ■ Sp(l) and its centralizer is 
C = Sp(l). If the involution p G iV is given by A ■ p, for A G Sp(m), p G Sp(l), then we 
have A 2 = ±1. From above we deduce that for all c G Sp(l) we must have (c ■ p) 2 = ±1. 
But this is impossible. □ 

Remark 6.1. Unfortunately, by this type of arguments it is impossible to exclude the remain- 
ing cases G° = U(2), G° = U(l) • Sp(2). In fact, one can find an extension of the action of 
such G° on V\ © V\ by an involution w such that w acts as a reflection on (V\ © Vi)/G°. 

We finish this subsection by noting that the Hopf action of U(l) on C 2 is equivalent to the 
action of the unit torus of SU(2) on C 2 . Thus we have finished the proof of Proposition 16. 1[ 
under the additional assumption that the action of G° has only one iso typical component. 

6.4. Generalized toric actions I. Now we proceed with the examination of the case of 
several isotypical components. In this and in the next subsection we will work under the 
general assumptions of the present section, and assume, in addition, that the action of 
G° on V has several isotypical components. We will denote by V = V\ ffi • • - © the 
unique decomposition into isotypical components. Due to Lemma I6.3[ the group G° acts 
on all Vi irreducibly and with cohomogeneity 1. Moreover, the group T = G/G° acts on 
S = {Vi, . . . ,Vi} as the full group of permutations. 

Proposition 6.7. Assume, in addition, that G° is a k-dimensional torus T. Then the action 
ofG° on V can be identified with the action of the maximal torus of the special unitary group 
SU(fc + l) on C w . 

Proof. Since all irreducible non-trivial representations of T have dimension 2, all Vi are two- 
dimensional. Thus each Vi is given by a character <pi : T — > S 1 which is defined up to 
conjugation, i.e., it is given by a (integral) linear functional d<pi on the Lie algebra t of T, 
which is defined up to sign. Since each irreducible summand of V is an isotypical component, 
each d(pi occurs exactly once, and T = G/G° acts as the full permutation group on the set 
of all dfa. 

We fix a T-invariant flat metric on T. Then the dfa have all the same length and we can 
identify each dcj>i with the line U which is orthogonal to the kernel of d(j>i in t. The image Q 
of r in the orthogonal group 0(k) = O(t) permutes the / elements U of the projective space 
BP*- 1 = p(t). 

Since the action of T is effective, the lines ti span t, thus I > k. If I — k, then T is a 
maximal torus of 0(V) and the action of T on V is polar (hence of non-trivial copolarity). 
Thus I > k + 1. As we have seen, Q permutes the finite set S of all tj and acts as the 
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full permutation group of this set S. Thus the distance between each pair of different U, tj 
in the projective space does not depend on % and j. Therefore the lines ti are equiangular 
in the Euclidean space t. In general, the sets of equiangular lines can be quite large and 
difficult to understand (cf. [LS66]). However, in the presence of the large group Q, they can 
be described quite easily: 

Lemma 6.8. Let t be a k- dimensional Euclidean vector space. Let S be a set of lines (1- 
dimensional subspaces) in t that consists of I > k elements and generates t. Let Q be a finite 
subgroup of O(t) that leaves S invariant and acts on S as the full group of permutations 
of S. Then I = k + 1 and the lines of S are generated by the vertices of a regular simplex 
centered at the origin in t. 

Proof. We proceed by induction on k. For k = 2 the claim is easily verified (for k — 1, such 
sets of lines do not exist). Assume the statement is already shown for the dimension k — 1, 
for some k > 3. 

Let a < tt/2 be the angle between any pair of lines from S, which by assumption does 
not depend on the pair. If a = tt/2, all lines are pairwise orthogonal, thus the number 
of lines is bounded from above by k, in contradiction to our assumption. If 3 lines ti, 
£3 G S lie in a plane, we must have a = ir/3. Choose another line £4. We can choose 
unit vectors Xj on tj such that the spherical distances (i.e., the Euclidean angles) satisfy 
<i(Xi,X 2 ) = c/(X 2 ,X 3 ) = <i(X 2 ,X 4 ) = n/3. Since X 4 does not coincide with ±Xi or ±X 3 , 
its distances to X x and X 3 are less than 27r/3. Thus they must be equal to n/3. But such 
quadruple of points does not exist in the unit sphere S 2 . 

Thus a < it/2 and any three lines in S generate a 3-dimensional space. Consider the 
subgroup Qi of Q that leaves ti invariant. Then it acts on ti, the orthogonal complement of 
t\ and it preserves the set Si of lines in ti that are projections of lines in S different from £1. 
Since no three lines lie in a plane, projections of different lines are different, thus S\ has k — 1 
elements. By assumption, Qi acts as the full permutation group of Si. By our inductive 
assumption, I — 1 = {k — 1) + 1. Hence I — k + 1. Moreover, by induction, the lines in Si 
are given by the vertices Y2, . . . , Yi of a regular simplex in ti. 

Fix a unit vector X x on ti. Choose the unit vector X 8 on = 2,...,k + 1, with 
d(Xi,Xi) = a. Then X, lies on the spherical geodesic from Xi to Yi. Moreover, by our 
assumption, for all i 7^ j, we have either d(Xi,Xj) = a or d(Xi,Xj) = it — a. However, 
the angle between X{Yi and X{Yj is larger than it/2. Thus the triangle XxXjXj cannot be 
equilateral. Hence d(Xi,Xj) = tt — a for all i 7^ j. Therefore if we set Xj = —X for i > 2, 
the (k + 1) unit vectors Xj have the same pairwise distances, given by it — a. Thus Xj are 
the vertices of a regular simplex. □ 

Now we can finish the proof of Proposition 16.71 We deduce form the last lemma that 
I = k + 1 and that, up to an eventual change of (pi by its conjugate (that does not effect the 
representation of the torus T), the homomorphisms 0j : T — > S l have differentials d(pi that are 
the vertices of a regular simplex. Hence these differentials satisfy d(j>i + d<p2 + ... + c?0fc+i = 0. 
But this is exactly the defining equation of the maximal torus of SU(/c + 1). □ 

6.5. Generalized toric actions II. In this subsection we are going to finish the analysis of 
the situation where the action of G° on V has several isotypical components V = Vi@- • - @Vi. 
Here we assume that G° is not commutative. Since all isotypical components are permuted 
by T = G/G°, the images Xj of G° in the isometry group of the isotypical components Vi 
are congruent inside 0(V). 
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Denote by K' the image of G° in O(Vi). Since G° is contained in a product of groups 
isomorphic to K' , the group K' is not commutative. Going through the list of groups K' 
acting with cohomogeneity one on a vector space, we get three cases that we will analyze 
separately: K' is covered by a simple group K; K' is covered by a group K with two different 
factors; K' is covered by K = Sp(l) x Sp(l). 

Case 1. Let us assume that K is a simple group. Then G° is a finite quotient of a product 
K m . Moreover, for any component Vj, exactly one of the m factors is mapped not to the 
identity in SO(Vj). If K ^ Spin(8) then there is exactly one irreducible representation of 
K with cohomogeneity 1 on a vector space of the fixed dimension dim V\ = dim V2 — ■ ■ ■ — 
dim V/. Thus, in this case, m = I and for each j = l,...,m there is exactly one V} such 
that the j-th factor K is mapped non-trivially into SO(Vj). We deduce that the action of 
G° on V is an /-fold product of the actions of K on V\. However, this action is polar. This 
contradicts our assumption. 

If K = Spin(8) then K has 3 representations p\, p2, p 3 of cohomogeneity 1 on R 8 that 
are permuted by the triality automorphism. Then the only part of the representation of 
G° on which a fixed factor K may act non-trivially is a sum of different pj, j = 1, 2, 3, 
i.e., a vector space of dimension at most 24. However, dimSpin(8) = 28. Thus the action 
of K on this subspace has non-trivial principal isotropy groups. Then the action of G° on 

V has non-trivial principal isotropy groups, as well. Thus it has non-trivial copolarity in 
contradiction to our assumption. 

Case 2. Now, we assume that the image K' is covered by a product K of two different 
factors (i.e., U(l) x SU(n), U(l) x Sp(n), Sp(l) x Sp(ra), for n > 2). In all cases, the action 
of one factor K of K is still of cohomogeneity 1. Consider the connected normal subgroup 
N of G° whose Lie algebra is the sum of all factors isomorphic to t, the corresponding Lie 
algebra. Since the factors of K are different, N is normalized by G. 

Consider the decomposition V = W\ © • • • © W r into iV-isotypical components. Since 
G° acts on N via inner automorphisms, any element of G° preserves each summand Wj. 
Any element g G G permutes the iV-isotypical components. If r > 1 then, arguing as in 
Lemma |6.3[ we deduce that the action of G° on each Wj has cohomogeneity 1, hence each 
Wj coincides with some Vj. As in the previous case, the action of N on V is a direct product 
of cohomogeneity 1 actions of iV on Vj. We deduce that the action of G° is orbit equivalent 
to the action of N on V and that both actions are polar. Contradiction. 

Therefore we may assume that r = 1. Then iV has only one factor, i.e., N is lo- 
cally isomorphic to K, which is either SU(n) or Sp(n). The representation of N on 

V is given by the /-fold sum of the vector representation V\ of K. Any nice involu- 
tion w G G normalizes N. Arguing as in Subsection 16.31 we get a presentation of w as 
w(vi, . . . ,Vi) = (p^ 1 (v 2 ) , p(vi) , p 3 (v 3 ) , . . . ,pi(vi)), for some involutions Pi G O(Vi) and some 
isometry p G O(Vj) such that they all normalize K, and such that p 2 , pp^ 1 lie in the cen- 
tralizer of K inside O(Vi), for i > 3. 

Assume / > 3. The set F of fixed points of w is given by all (v,p(v), f 3 , . . . , /;) with v G V\ 
and the fi fixed by pj. The extension of the action of iV to the action of G° is given by some 
(complex, respectively, quaternionic) scalar multiplications in each component. Note that 
p and pi induce the same action on the projective spaces CP n_1 and HP™ -1 , respectively. 
Thus the set S = G° ■ F is contained in the set of all points with the first three coordinates 
(ui, 112,113) given by (g(v)Xi, g{p-i{v ))\2, g{.h)^s) for some scalars Aj, some element g G K, 
some v G V\ and some f 3 in V\ fixed by p 3 . 
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We have |«i| = \u%\. Moreover, the "lines" [m], [1X2], [^3] (i-e. the elements of the cor- 
responding projective space) are given by g([t>]), g(p3[v}), pQ/s]), where [/ 3 ] is fixed by the 
involution p 3 in the projective space. Thus <i([wi], [u^]) = (£([112], |W]) in the projective space 
P(Vi) (over C and H, respectively). Hence the set S has codimension at least 2 in V, and 
w cannot act as a reflection. This provides a contradiction in the case / > 2. 

We deduce I = 2. Since the action of G° has trivial copolarity, the action of G° and 
therefore of N on V = V% © V 2 has trivial principal isotropy groups. From the classification 
of cohomogeneity 1 actions, we deduce that K = SU(n), with n = 2 or 3, or K = Sp(2). 

If dim(G°/iV) > 3 then dim(V) - dim(G°) < 3 in all cases. Thus, due to [Strji] . the 
action of G° cannot have trivial copolarity. Hence dim(G°/A r ) < 2. If dim(G°/N) = 1, 
then, using the fact that the representations V% and V 2 of G° are congruent inside G, we see 
that both representations are equivalent. Hence there is only one G°-isotypical component, 
in contradiction to our assumption. Therefore G°/N is the two-dimensional torus T 2 . If 
K = SU(n) we get dim(V) — dim(G°) < 3 again, in contradiction to the trivial copolarity 
assumption. Thus G° must be finitely covered by Sp(2) x U(l) 2 . Now V\ = V 2 = H 2 and we 
use the canonical real basis {l,i,j,k} of H. Up to orbit-equivalence, we may assume that 
each U(l)-factor acts on the corresponding summand H 2 by right multiplication by matrices 
of the form e ie id. Now a(vi,v 2 ) = (—jvij,—jv 2 j), for (vi,v 2 ) G V\ © V 2 , is an involution 
that preserves each G°-orbit. It follows that the action of G° on V has non-trivial copolarity 
in contradiction to our assumption. 

Case 3. Now assume that the image is covered by a product K of equal factors. Then, 
K is Sp(l) x Sp(l), dimVi = 4 for all i, and G° is mapped onto SO(4) in this case. Thus 
G° is covered by a product Sp(l) m for some m. 

Denote as above by T the group G/G°. This group permutes the m factors of (the universal 
covering of) G°, hence is mapped onto a subgroup T' of the symmetric group S m . Note that 
on each Vi exactly 2 factors of G° act non-trivially. Thus the isotypical components can be 
indexed by a subset A of the set of unordered pairs of different factors. We will denote such 
unordered pairs by % ® j, 1 < i,j < m. The action of V on the set of G°-components factors 
through V . Moreover, the action of V on A is induced by the canonical action of S m on the 
set of unordered pairs. Due to Lemma 16.31 the image of T' is the whole permutation group 
of A. 

The cardinality of A is t. Since T' acts as the full permutation group of A, we have I < m. 
For any i — 1, . . . , m, we set A^ — {j | i <g) j £ A} and denote by a(i) the cardinality of Ai. 
If Q>(i) > 2, for all i, then A has at least m elements, so i = m. It follows that V = S m and 
hence A has m(m — l)/2 = m elements. Hence m — 3. Then dim(V") = 12 and dim(G°) = 9. 
Thus the action of G° on V cannot have trivial copolarity by [Str94j . 

Hence there exists some i with a(i) = 1. If a(i) = 1, for all i, then the action of G° is the 
direct product of the cohomogeneity 1 representations of G° on Vi. Thus the representation 
is polar in contradiction to our assumption. 

Thus, there are some % with a(i) = 1 and some j with a(j) > 1. Note that the number 
a{i) is constant on orbits of V . Since V acts transitively on A, for all pairs i <8> j G A, the 
unordered pair a(i) <8> a(j) does not depend on i ® j. Hence there are exactly two orbits B 
and C of V in {1, . . . ,m}, one of them, say B, consisting of all % with a{%) = 1, and the 
other one C consisting of all elements j with a(j) = a > 1. 

Assume that C has at least two elements ji, j 2 . Choose distinct elements i± G B such 
that ji <S) i± G A. Then there is no element in V that leaves j± ® i + invariant and moves 
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ji £g) i- to some pair j2 ® %■ Contradiction to the fact that V acts as the full permutation 
group on A. 

Thus, C has only one element that we may assume to be {m}. Then B has m — 1 elements, 
and the action of the first (m — 1) factors on V is a (polar) product action. One sees that 
the action of G° is in this case polar as well (and has non-trivial principal isotropy group). 

This finishes the proof in the case the image of G° in V\ is covered by a product of equal 
factors. 

Taking all pieces together, we have completed the proof of Proposition 16.11 

7. An example 

Before we finish the proof of Theorem 11.21 we need to collect a few observations about the 
geometry of the action of a maximal torus T of SU(A; + 1) on V = C k+1 . 

Lemma 7.1. The quotient V/T has no boundary. 

Proof. No circle inside T fixes a subset F of complex codimension 1. Since T is commutative 
we derive the result from the dimension formula (Lemma 14.11) . □ 

In particular, the action of any finite extension of T has trivial abstract copolarity, due to 
Proposition 15.21 

Note that the normalizer N = N(T) of T in 0(2k + 2) normalizes the centralizer T of 
T in 0(2k + 2). Assume k > 2. Since T is a maximal torus of XJ(k + 1) which is also a 
maximal torus of 0(2k + 2), we see that T is the identity component of the normalizer N. 
Moreover, N is generated by T, the complex conjugation c and the symmetric group Sk+i 
of permutations of complex coordinates. On the other hand, the case k = 1 is discussed 
in [StrM p. 14]. 

Lemma 7.2. Assume k > 1. Then the action of the normalizer N (T) = N ofT in 0(2k + 2) 
on the quotient V/T induces an isomorphism of N/T with the isometry group Iso(V/T) of 
V/T. 

Proof. For k — 1, the result is contained in [Str94l p. 14]. Thus we will assume k > 2. 

If an element oi N\T acts trivially on V/T we obtain an action by a group X" larger than 
T that is orbit equivalent to the action of T. This would imply that the action of T' had 
non-trivial principal isotropy group. Hence the action of T' (and thus of T) had non-trivial 
copolarity. Contradiction. Thus the map from N/T to Iso(V/T) is injective. 

To prove the surjectivity, take an isometry / of V/T to itself. Restrict it to the unit sphere 
X = S(V)/T. There are k + 1 irreducible subspaces of V, each of them defines a unique 
point pi in X, for i = l,...,k + 1. Due to Lemma 15.11 these points are permuted by /. 
Composing / with an element of N that permutes the complex coordinates backwards, we 
may assume that / fixes the points pi. 

Let N' denote the subgroup of the isometry group of V/T that fixes all the points pi. The 
intersection of N' with the image of N is the group 0(2) generated by the image of T and 
the complex conjugation. We have to prove that N' = 0(2). In order to do so, consider the 
map F = (d Pl , d P21 . . . , d Pk+1 ) : X — > H k+l whose coordinates are distance functions to the 
points pi. By construction, the function F is N'- invariant. We claim that the fibers of F 
are the orbits of T. Namely, due to the iV'-invariance, the orbits of T are contained in the 
fibers of F. On the other hand, Y = X/T = S(V)/T is the rectangular spherical simplex 
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with vertices given by the points pi. And the function F that descends to Y separates the 
points of Y. 

Thus the regular fibers of F are circles. The group N' acts effectively on X having circles 
as regular orbits. This implies that N' can be only U(l) or 0(2). Since its intersection with 
N is already 0(2), the whole group N' must coincide with this intersection. □ 

As a consequence we deduce: 

Corollary 7.3. Let T%, T2 be finite extensions of T in 0(2k + 2). If V /T\ and V/T2 are 
isometric, then T\ and T2 are conjugate inside N(T) . 

Proof. Consider an isometry J : V/T x — >■ V/T 2 . Since V/T does not have boundary, (V/T) orb 
is the universal orbifold covering of {y/T/) orb (Lemma 13.51) . Then the isometry J is induced 
by an isometry / : V/T — >■ V/T, and we can use the preceding lemma to lift I to an element 
n of N(T). Now nT\n~ x /T and T2/T have the same orbits in V/T implying that nT\n~ x 
and T2 have the same orbits in V . Since they both act with trivial copolarity it follows that 
they are equal. □ 

Lemma 7.4. Assume k > 2. Let T + be a finite extension of T such that T + /T acts on 
V/T as a reflection group and such that T + acts on V irreducibly. Then there are two 
codimension 1 strata in V/T + that meet at an angle not equal to tt/2. 

Proof. We have seen in Lemma 16.31 that T + /T acts as the full permutation group on the 
components of V. Thus the finite reflection group T + /T, which is the orbifold fundamental 
group of (V/T + ) orb surjects onto the non-Abelian symmetric group Sk+i- However, if all 
strata of codimension 1 would only meet at right angles, the orbifold fundamental group of 
{V/T + ) orb would be Abelian, cf. the end of Subsection 13.21 (More directly, it is not difficult 
to observe that two reflections w±, W2 corresponding to non-commuting transpositions in 
Sk+i define strata of codimension 1 that meet at an angle equal to vr/3.) □ 

From this we deduce our final piece: 

Corollary 7.5. Assume that k > 1. Assume that a representation p : H — >■ 0(W) is 

quotient equivalent to a finite extension 7\ of T in 0(2k + 2). If the action of H° on W is 
irreducible, then the principal isotropy group of H is non-trivial. 

Proof. The representation p is irreducible. For k — 1, it has cohomogeneity 3 and thus it is 
listed in group III, Table II in [ Str94] . Those have non-trivial principal isotropy groups. 

Assume k > 2. Due to Proposition 13.11 and Lemma 17.11 we find a subgroup T + of T\ of 
finite index in T\ such that the representation of H° on W and of T + on V are quotient 
equivalent. Since H° is connected, we see that T + /T acts on V/T as a reflection group 
(Lemma 13.51 and Lemma 133]) . Since H° acts irreducibly, so does T + (Lemma 15. ip . Applying 
the previous lemma and Lemma 14.21 we deduce that H° (and therefore H) acts with non- 
trivial principal isotropy group. □ 

Remark 7.1. We would like to mention that Lemma [7.41 does not hold for k — 1, see [Str94| 
Table II]. 

8. Conclusion 

Now we are going to finish the proof of Theorem 11.21 
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Consider the action of H' on W and take its reduction to a minimal generalized section V . 
Let r : G — > 0(V) be this reduction. By construction it has trivial copolarity and is in the 
same quotient equivalence class as p : H — > 0(W). Since V is also a generalized section of 
(H')°, we see that the action of G° on V is reducible. 

Due to Proposition I3.2| we find subgroups of finite index H + in H and G + in G such 
that the corresponding restricted representations are still quotient equivalent and such that 
G + /G° acts on V/G° as a reflection group. Since H + contains H° it acts irreducibly and 
so does G + , due to Lemma [5.11 In particular, G + /G° is a non-trivial group. Now, if G is 
non-discrete, we are in the situation of Proposition 16. II We deduce that either the action of 
G° on V is as required, or that G° is one of the groups U(2) or U(l) ■ Sp(2) and V is the 
double of the vector representation (on C 2 and H 2 , respectively). 

Assume that G° = U(2). Then the action of G, hence that of H has cohomogeneity 
4. We use the explicit classification of all irreducible representations of cohomogeneity 4 of 
connected groups ( Theorem 1 1 . 41 1 hat is proven independently in the second part of the paper). 
If H° is SO (3) or U(2) (the first two lines in the table), then W/H° has no boundary. Due 
to Proposition 13. 1| we find a subgroup Hi of finite index in H such that W/ Hi and V/ G° 
are isometric. But Hi acts irreducibly and G° acts reducibly, in contradiction to Lemma [57T1 
On the other hand, if H° has non-trivial copolarity, then it has copolarity 2, according to 
Theorem 11.41 Since the copolarities of H and H° coincide, we find a reduction of if to a 
representation of a group K on U with K° = T 2 . The action of K has trivial copolarity and 
the representation of K° is reducible. Thus applying the arguments we have applied to G 
(Propositions 13.21 and 16. ip . we see that K° is the maximal torus of SU(3) and U = C 3 . Since 
U/K° has no boundary (Lemma 17. ip we use Proposition 13. 1| to find a finite index subgroup 
Ki of K such that U/K\ and V j G° are isometric. But the action of G° on V has infinitely 
many invariant subspaces (it is reducible with one isotypical component) and the action of 
Ki on U only finitely many. This contradicts Lemma \5. II Hence the case G° = U(2) cannot 
occur. 

Assume now that G° = U(l) • Sp(2). Then the action of G° has cohomogeneity 5, hence so 
does the action of H. We use again the explicit classification of all irreducible representations 
of cohomogeneity 5 of connected groups (Theorem 11.41 that is proven independently in the 
second part of the paper). If H° is SU(2), then W/H° has no boundary and we get a 
contradiction as above (Proposition 13 . 1 1 and Lemma IBTTj) . On the other hand, if the copolarity 
of H°, hence of H is 3, then by the direct computations in the second part, the reduction 
to the minimal generalized section has a torus T 3 as identity component. Then arguing as 
in the case of cohomogeneity 4 we obtain a contradiction. It remains to analyze the cases 
H° = SO(3) x U(2) and H° = U(3) x Sp(2). Since the latter action has a reduction to the 
former one in terms of a generalized section, we may assume that H° = SO(3) x U(2). 

To exclude this remaining case, we observe that S(V)/G° is a Riemannian orbifold. In 
fact it is easy to determine the equivalence classes of the slice representations at singular 
points. There are only three possibilities, in which the nontrivial components of the slice 
representation are respectively orbit equivalent to (U(1),C) © (Sp(l),H), (U(1),C) and 
(Sp(l),H). Since these are polar representations, the claim follows from the main result 

of [Ltto] . 

On the other hand, the slice representation of the identity component of the isotropy group 
of H° at a vector vi <g> v<i is given by T 2 acting on C © C © C with weights (1, 0), (1, 1), 
(1, —1), hence it is non-polar. Thus S(W)/H has non-orbifold points |LT10j . 
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This proves that G° is the maximal torus of SU(A; + 1) and V = C k+1 . 

Remark 8.1. A more conceptual proof that the two special cases cannot occur can be obtained 
as follows. One shows that both quotient spaces S(V)/G° are orbifolds of constant curvature, 
i.e., finite quotients of some round spheres. Hence the same is true for S(V)/G = S(W)/H. 
One invokes a recent theorem of Wiesendorf |Wiell] saying that in this case all i?-orbits are 
taut submanifolds of W. Now one uses the main result of |GT03] that states that the action 
of H on W must be of cohomogeneity 3. 

Assume now that there is another representation p\ : G\ — > O(Vi) in the same quotient 
equivalence class that has trivial copolarity. Due to Corollary I7.5| the representation of G\ 
cannot be irreducible. Since it is reducible, we may apply the same arguments we have 
applied to G, to deduce that the restriction of pi to G\ is given by the action of a maximal 
torus of SU(/c' + 1) on C fc +1 . Since the actions have the same cohomogeneity, k — k' and 
the representation spaces of G\ and of G° can be identified. To prove that p and p\ are the 
same, we only need to invoke Corollary 17.31 

9. New setting 

In the next two sections we are going to prove Theorem 11.11 Thus let here and in the 
sequel p : H — >■ 0(W) be a non-reduced non-polar irreducible representation of a connected 
compact Lie group. Let r : G — > O(V) be the minimal reduction. Note that if the copolarity 
k of p as in the assumption of the theorem is at most 6, then the abstract copolarity dim(G) 
is not larger than 6 as well. If the action of G° is reducible, then we can apply Theorem ll.2l to 
deduce that the copolarity and the abstract copolarity coincide and that the cohomogeneity 
is equal to k + 2. 

Thus Theorem 11.11 is a consequence of the following result that will be proved in the next 
two sections. 

Proposition 9.1. Assume that p : H — » 0(W) and r : G — > O(V) are quotient equivalent. 
Assume that H is connected, r has trivial copolarity k = dim(G) < 6 and that dim(iJ) > 
dim(G). Then the representation of G° is reducible. 

Form now on assume, to the contrary, that the action of G° is irreducible. By assumption, 
the action of G is effective, hence the Abelian summand of the Lie algebra of G° is at most 
one-dimensional. Since dim(G) < 6, the group G° is locally isomorphic to Sp(l), or U(2), 
or Sp(l) x Sp(l), respectively. 

We will distinguish two cases depending on whether G is connected or not. In the first 
case V/G = V/G° has boundary. We will exclude this case in the next section using a bit of 
representation theory. If G ^ G° then there is a nice involution w G G\G° (Proposition 13 ,2p . 
Using the dimension formula for the set F of its fixed points, we will obtain a contradiction 
in all but two cases that will be excluded by the general classification in the second part of 
the paper. 

10. Connected case 

10.1. Basics. In addition to our assumption from the previous section, we assume here that 
G is connected. Then there is some G-important point p such that G p is either U(l) or 
SU(2). In all cases (G = G° covered by SU(2) or SU(2) x U(l) or SU(2) x SU(2)) any 
SU(2)-subgroup contained in G has a unique involution that is central in G. Since such a 
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central involution cannot have fixed points (our representation is irreducible!), we cannot 
have G p S SU(2). 

We fix an important point p whose stabilizer G p is some U(l). Let F be the set of fixed 
points of G p and let / denote its dimension. Then we have (Lemma 14. ip the dimension 
formula / = dim(V) - dim(G) + &mx{N{G p )) - 2. 

10.2. A note on weight spaces. To obtain an upper bound for / we make the following 
general observation that allows us to estimate F using the weights of the representation. 

Let t be a representation of a connected compact group K on a complex vector space U. 
Let L be a subgroup isomorphic to U(l). Choose a maximal torus T containing L . Let F be 
the set of fixed points of L. Then F is T-invariant, hence it is a sum of weight spaces. Note 
that all these weights vanish on L, hence the weight spaces appearing in F are associated to 
weights contained in a hyperplane in the dual space of the Lie algebra t of T. 

If U is a real vector space, then one can consider its complexification U c = U © ill, and 
obtains that the set F c C U c is a sum of weight spaces whose corresponding weights are 
contained in a hyperplane of the dual space of t. 

If the rank of K is 1, then the only hyperplane in the dual of the Lie algebra of T is {0}, 
hence F (respectively F c ) is contained in the 0-weight space. 

Assume now that K has rank 2. Then all hyperp lanes are one-dimensional. Thus all 
weight spaces appearing in F must be linearly dependent. (In fact, they are all multiples of 
the weight given by T ^ T/L = U(l).) 

10.3. G is covered by SU(2). Here we assume that G has rank 1. Then all irreducible 
representations of G are given by the quaternionic representations pm on the complex space 
C 2n of homogeneous polynomials of degree 2n — 1 in two complex variables and by the real 
representations P2n+i on R 2n+ . 

From the previous subsection we see that / is bounded from above by the real dimension 
of the 0-weight space in the quaternionic case and by the complex dimension of the 0-weight 
space in the real case. 

In the quaternionic case, the 0-weight space is trivial (this already implies that there are 
no G-important points!) and, in the real case, it is 1-dimensional. Thus we get dim(V) = 
dim(G) - dim(N(G p )) + / + 2<3-l + l + 2 = 5. If follows that the cohomogeneity of the 
action is at most 2 and hence it is polar. Contradiction. 

10.4. G is covered by U(l) x SU(2). Then all irreducible representations of G are complex. 
For each n there is a exactly one irreducible representation p n of G on C n . The restriction of 
each weight to the central U(l) of G is independent of the weight, thus there are no linearly 
dependent non-equal weights. One knows that each weight space is complex 1-dimensional. 
Thus we deduce / < 2. Since dim(N(G p )) > dim(T) > 2, we get from the dimension 
formula dim(V) < 6. Again the cohomogeneity of the action is at most 2 and hence the 
representation must be polar. Contradiction. 

10.5. G is covered by SU(2) x SU(2). In this case the complex irreducible representations 
of G are given by p m <g> p n on C m ®c C". Using that all weights have multiplicities 1 for 
p n and p m , we see that any number of linearly dependent weights of p m <g> p n has at most 
min{m, n} elements. Without loss of generality, we assume m > n. 
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If m, n have different parity, then the representation V is quaternionic and we get 
dim(V^) = 2mn, dim(F) < 2n. On the other hand we get from the dimension formula: 
2mn < 6 + 2n. Hence n(m — 1) < 3, which is impossible as m > n. 

If m, n have the same parity, then the representation V is real, and the dimension formula 
gives us mn < 6 + n. Hence, n(m — 1) < 6. Thus either m = n = 3 and the corresponding 
representation of SO(3) x SO(3) on R 3 eg) R 3 is polar, or m = n = 2 or m = 4, n = 2 which 
have cohomogeneity at most 2 and hence are also polar. 

11. Disconnected case 

11.1. General useful observations. Here we are going to work with a nice involution w G 
G\G . This involution normalizes G°. We denote the set of the fixed points of w by F and 
the dimension of F by /. We have the dimension formula: / = dim(V)— dim(G)+dim(C) — 1. 
Here C is the centralizer of w in G. 

We will often use the following observation: 

Lemma 11.1. Let K C 0(U) be a closed subgroup such that K° is locally isomorphic to 
Sp(n). Assume that K° acts irreducibly on U and there is an involution w G K\ K° . Then 
either K° = Sp(n)/Z2 and w = —w', for some involution w' G K° , or K° = Sp(n) and, 
for some complex structure on U, the involution w and the group K° are contained in the 
unitary group of U. 

Proof. The involution w acts by conjugation as an automorphism on K°. Since K° does not 
have outer automorphisms, we find some j G K° such that conjugation with j induces the 
same automorphism as conjugation with w. Then the element q = j~ l w commutes with K°. 

Since w is an involution, we have (jq) 2 = j 2 q 2 = 1. Thus q 2 G K°. Since q commutes 
with K°, the element q 2 must be in the center of K°. If K° = Sp(n)/Z 2 then q 2 must be 
the identity, i.e., q is an involution. Since the representation of K° is irreducible and w is 
not in K°, we must have q — — 1, hence w = —j. 

If K° = Sp(n), then the element —1 is contained in K° (it is the only non-trivial involution 
that can commute with an irreducible representation). Hence, the same reasoning as before 
shows that q 2 = 1 would imply that w is contained in K°. Thus we must have q 2 = — 1. 
Then j and w commute with q, and we finish the proof by taking the complex structure 
defined by q. □ 

11.2. G° is covered by SU(2). Assume that G° is covered by Sp(l) = SU(2). If G° = 
SU(2) then dimension of V is even and, due to Lemma [TUT} the involution w must preserve 
a complex structure. Hence its set F of fixed points has even dimension. The dimension 
formula / = dim(V) — 3 + 1 — 1 provides a contradiction. 

Assume now that G° = SO(3). Then V = R 2n+1 for some n. The dimension formula gives 
us/ = 2n + l — 3 + 1 — 1 = 2n — 2. On the other hand, due to Lemma [11.11 the involution 
w is given by —w' for some involution w' G SO (3). However, the (up to conjugation unique) 
involution w' in SO (3) fixes a subspace of dimension n, if n is odd, and of dimension n + 1, 
if n is even. Thus f = 2n + 1 — n = n + 1 ot f = 2n + 1 — (n + 1) = n, respectively. 

By inserting into the previous equation, we deduce that n = 3 or n = 2. The case n = 2 
is polar (thus excluded) and we are left with the case n = 3. 

Summarizing, we have shown that if G° is locally isomorphic to Sp(l), we must have 
G° = SO(3) and V = R 7 . However, in this case the action of G on V has cohomogeneity 
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4. The explicit classification given by Theorem 11.41 shows that this case cannot occur as a 
non-trivial reduction, since there are no representations of copolarity 3 listed in Table 1. 

11.3. G° is covered by U(l) x SU(2). The representation space V is the complex space 
C ra . The center of G° is a circle U(l) that acts on C n as complex multiplication. Our nice 
involution w normalizes this circle. Thus w is either complex linear or complex antilinear. 
We have that / is even in the first case and / = n in the second case. 

In the complex linear case, the centralizer of w has dimension 2 and the dimension formula 
yields f = 2n — 4 + 2 — 1 = 2n — 3. This contradicts the fact that / is even. 

In the complex antilinear case, the centralizer of w has dimension 3, if w commutes 
with SU(2), and dimension 1, if it does not commute. In the first case we deduce / = 
2n — 4 + 3 — 1 = 2n — 2 and in the second case f = 2n — 4+1 — 1 = 2n — 4. Using that 
/ = n we derive n = 2 in the first case and n = 4 in the second case. 

The case n = 2 is polar. Thus we are left with the case n — 4. However, in this case the 
quotient V/G° has again cohomogeneity 4. Thus this case is excluded by the classification 
result Theorem 11.41 

11.4. G° is covered by SU(2) x SU(2). There are three cases to be analyzed: 

(I) SU(2) • SU(2) acting on H m ® H H n ; 
(II) SO(3) x SO(3) acting on R 2m+1 ® R R 2n+1 ; and 
(III) SO(3) x SU(2) acting on R 2m+1 ® R H n . 

For our nice involution w we have the formula / = dim(V) — 7 + dim(C). The conjugation 
by w can act on G° as an inner or as an outer automorphism. We deal with these two cases 
separately. 

Outer automorphism. We assume first that w acts on G° not as an inner automorphism. 
Then w must interchange both factors of G°. Thus we must be in cases (I) or (II). Moreover, 
the equality of dimensions m = n must hold true. 

By conjugating w with an element in G° we may assume that w acts on G° by interchanging 
the factors, hence by sending ((71,(72) to (g 2 ,g\). 

Consider the involution i : V — > V defined by interchanging the equal factors of V: 
i(h\ ® /12) = h,2 <S> h\. Then i normalizes G° and the conjugation with i acts on G° by 
interchanging the factors of G°. Therefore, woi commutes with G°. Since the representation 
of G° is of real type, we must have w = ±1 Moreover, in both cases, the centralizer of w is 
the diagonal of G° that has dimension 3. 

From the dimension formula we conclude that dim(V) — / = 4. In case (II), the dimensions 
of the sets of fixed points of i and —i are given by (2n + l)(2n + 2)/2 and (2n + l)(2n)/2, 
respectively. Since both numbers are larger than 4 for n > 2 (n = 1 is polar), we get 
dim(y) — / > 4 and a contradiction. 

In case (I), the dimensions of the sets of fixed points of % and —i are n(2n— 1) and n(2n+l), 
respectively (note that viewing H n ®h H n as the real vector space of quaternionic matrices 
of order n, the involution % corresponds to transpose conjugation X 1— > X*). Again, for n > 1 
(n = 1 is polar), both numbers are larger than 4. Hence dim(V) — / is larger than 4 and we 
derive a contradiction. 

Inner automorphism. We assume now that w acts on G° by an inner automorphism. 
Then w = qj, for some q that centralizes G° and some j G G°. 
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In cases (I) and (II) the representations are of real type, hence the centralizer of G° consists 
of ±1. Since w is not in G°, q must lie outside G°. In case (I), the element —1 is contained 
in G°, thus we get a contradiction directly. 

In case (II) we must have q = —1. Thus w = —j and j must be an involution in G° that 
is given by a product j = j% ■ j 2 , where each ji is either an involution or the identity in the 
corresponding factor of G°. 

By the dimension formula, the set of fixed points of j must have dimension equal to 7 — c, 
where c = dim(C). Denoting by ji the set of fixed points of —ji and by e; the set of fixed 
points of ji, we get 7 — c = /i • / 2 + e\ ■ e 2 . 

If ji is not the identity, then e\ = m if m is odd and m + 1 if m is even. And the 
corresponding statement is true for j 2 . 

If ji = 1 then c = 4 and we have 3 = (2m + l)e 2 . Hence e 2 = 1 and m = n = 1 and our 
representation is polar, in contradiction to our assumption. Similarly, j 2 = 1 is impossible. 

If ji and j 2 are both different from the identity, then c = 2 and in all cases we get 5 > 2mn. 
For m — n — 1, we have a polar representation and, for m — 1, n — 2, the dimension formula 
reads as 5 = 1 ■ 3 + 2 • 2, thus we derive a contradiction. 

We are left with the case (III). In this case q 2 = j~ 2 is contained in the center of G°. 
Thus either q 2 = 1 or q 2 = — 1. If q 2 = 1 then (since q commutes with G°), it must be that 
q = ±1. But —1 is contained in G°, hence we would get q G G°, which is impossible. 

Hence, we must have q 2 = —1. Therefore w is a complex involution with respect to the 
complex structure defined by q. Therefore, dim(V) — / is an even number. However, c is 
either equal to 2 or to 4, hence 7 — c is odd. This provides a contradiction. 

Part 2. Irreducible representations of cohomogeneity 4 or 5 

In this part, we classify the non-polar irreducible representations of cohomogeneity 4 
or 5 and prove Theorem 11.41 Throughout, we use the lists of isotropy representations of 
symmetric spaces |Wol84] . additional polar representations [EH99j, and representations of 
cohomogeneity at most 3 |HL71j (see also |Uch80t IYas861 IStr96j ) . 

12. Preliminaries 

Let p = (G, V) be a real irreducible representation of a compact connected Lie group G 
on a real vector space V. Denote by c(p) the cohomogeneity of p. 

12.1. Basic dimension bound. It is obvious that 

dim V < dim G + c(p) . 

12.2. Types. Recall that, by Schur's lemma, the centralizer of p(G) in End(K) is an as- 
sociative real division algebra, thus, by Frobenius theorem, isomorphic to one of R, C or 
H; accordingly, we say that p is of real, complex of quaternionic type. There are many 
alternative characterizations of such types; the following one is often useful, p is of real type 
if and only if its complexification p c remains irreducible; in this case, p is a real form of a 
complex irreducible representation. Otherwise, p c = it © it*, where 7r is complex irreducible 
and p is equivalent to the realification ir r ; here p is of quaternionic (resp. complex) type if 
Ti and Ti* are equivalent (resp. not equivalent), where tt* denotes the dual representation. 
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12.3. Quaternionic matrices. For practical computations, it is often useful to work with 
quaternionic matrices. We view a quaternionic vector space V as a right H- module Vn- The 
set Hohi(Vh, Wn) of H-linear maps Vn — > Wn is a real vector space; in the special case 
V* = Hohi(Vh,H h ), since H is a bimodule, we get a left H-module structure h^*- Now 
Wh^hV* is well defined and a real vector space, and there is the usual canonical isomorphism 
Wn (g) h^* — Hom(VH, Wn); this is G-equivariant in case V, W are G-representations of 
quaternionic type. It is also clear that Wn g) h^* is a real form of W ®c V*- Having said 
this, henceforth we write just W £g>H V for Wn <8> h^*- 

12.4. Slices and sums. The slice representation at v G V is the induced representation of 
the isotropy group G v on the normal space N v (Gv). It is known that the cohomogeneity 
of a slice representation is equal to the cohomogeneity of the original representation. This 
works as an inductive argument allowing one to compute precisely the cohomogeneity (com- 
pare [HH70J). One can also apply this remark to sums. Let p = pi ®p 2 be the representation 
(G, Vi © V 2 ). Let V\ G V\ be a regular point for (G, V\). Then consideration of the slice of p 
at Vi yields 

c(p) = c( Pl ) + c(G Vl ,V 2 ). 

In particular, c(p) > c(pi) + c(p 2 ) and equality holds if and only if (G V1 , V 2 ) is orbit equivalent 
top 2 = (G,V 2 ). ' 

12.5. Tensor products. It is convenient to introduce the following notation. If A and B 
are classical groups, we shall denote by A ® B the irreducible representation given by the 
tensor product of the vector representations (the field over which the tensor product is being 
taking is determined by the types of the factor-representations). 

In general, for a tensor product p = (G = G\ x G 2 ,Vi ©p V 2 ), where dimV^ = and 
F = R, C or H, we respectively have 

p(G) C SO(m) <8> SO(n 2 ); or 
p(G) C U(n x ) <g)U(n 2 ); or 
p(G) c Sp(ni) © Sp(n 2 ). 

It follows that 

c(p) > min{rii, n 2 }. 

The following monotonicity lemma will be used to simplify the estimation of the cohomo- 
geneity of some representations. 

Lemma 12.1. Let p\ = (Gi,Vi) be an arbitrary real representation, and let p 2 (n) = 
(G 2 (n),F n ) be the standard representation o/0(n), U(n), Sp(n) on R n ; C n , H n ; respec- 
tively. Assume p\ is of F-type for F C F and consider the tensor product p(n) = {G(n) = 
Gi x G 2 (n), V x ®f F n ). Then c{p{n)) < c(p(n + 1)). 

Proof. Since the cohomogeneity is the topological dimension of the orbit space, it is 
enough to show that the orbit space of p(n) injects into that of p(n + 1). Since V\ is a real 
representation, we can identify V\ with V* and replace the tensor product by the space of 
linear maps C n = Homp(V 1 , F"). Now (gi,g 2 ) G G\ x G 2 {n) acts on A G C n by mapping 
it to g 2 Ag{ x . We consider the standard embedding C n — > C n+ \. To prove the desired 
injectivity, we just need to show that any two elements A, B e C n that are in the same 
G(n + l)-orbit must be in the same G(n)-orbit. It is obvious that we can restrict to the case 
G\ = {1}. In this case A and B are respectively given by m-tuples (ai, . . . , a m ), (bi, . . . , b m ) 
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of elements in F™ C F n+1 where m = dinip V\. Let g 2 G G 2 (n + 1) such that g 2 A = B. One 
restricts g 2 to the subspace of F™ spanned by ai, . . . , a m and then extends it to an element 
ofG 2 (n)cG 2 (n+l). □ 

Corollary 12.2. We have c(G x © SU(n)) < c{G x © SU(n + 1)) + 1. 

12.6. Slices of products. Let pi be a real irreducible representation of a Lie group G{ on 
Vi, where i = 1,2. Then p = pi©R,p 2 is a real representation of G = G\ x G 2 on V = ^©rV^ 
which is irreducible if at least one of the pi is of real type. Let v = v i <g> v 2 G V be a pure 
tensor where G is regular. Then is a principal isotropy subgroup of pi and the 
connected isotropy group {G v )° equals H — Hi X H 2 , where = (G Vi )°. Since the normal 
space 

N v (Gv) = Rv® [v x ® (iV^(G 2 f 2 ) e Ru 2 )] © [(^(Giui) Rfi) ® u 2 ] © [f^ © u^] , 

by considering the slice representation at v, we get 

c(p) = c(H, vi © 4) + c(pi) + c(p 2 ) - 1. 

We will mostly use this remark in case c(pi) = 1 for % = 1, 2; then the decomposition of 
f 1 © f 2" into irreducible components is easier. 

In the cases of complex and quaternionic tensor products, one uses similar though slightly 
more complicated arguments that we explicit below in the individual cases. 

12.7. Cohomogeneity c(p) = 1. The list of transitive linear actions on spheres is well 
known (cf. Theorem of Borel-Montgomery-Samelson). We include it for easy reference. Here 
and below, p always denotes a real representation, so e.g. p = (SU(n),C n ) means the 
realification of C n . On the other hand, if W is complex, [W]r denotes a real form. 
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12.8. G is simple and 2 < c(p) < 8. A lemma of Onishchik [Oni62t Lemma 3.1] ex- 
plains that the dimension of a complex irreducible representation is an increasing function 
of the highest weight, where one uses a partial order naturally defined on the set of dom- 
inant integral weights. Using this lemma, it is a matter of patience to list real irreducible 
representations of low cohomogeneity of simple groups. In the tables below we go up to 
cohomogeneity 8 (the tables in [HH70, ch. I, §2] are also helpful). Up to a few cases, our list 
can also be obtained from Lemma 2.6 in |Kol02] . 
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12.8.1. Polar representations. 
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12.8.2. Non-polar representations. 
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13. Products of mixed type 

Having already discussed simple groups, we next turn to the case of representations p of 
non-simple groups G with c(p) = 4 or 5. We roughly divide the discussion according to the 
types of the factors and start with the case of mixed type. 

Lemma 13.1. We have c(SO(m) R Sp(n)) > 11 for m > 3 and n > 2, and c(SO(m) R 
Sp(l)) > 7 for m > 4. Moreover c(SO(3) R Sp(l)) = 6 and c(SO(3) R U(2)) = 5. 

Proof. By dimensional reasons, c(SO(3) x Sp(2)) > 11 and c(SO(4) x Sp(l)) > 7, so the 
first two assertions follow from Lemma 112. II The cohomogeneity of SO (3) R U(2) can be 
directly computed by using slices and noticing that the principal isotropy group is trivial, 
and then the other cohomogeneity follows. □ 

Lemma 13.2. For m > 3, n > 3 we have c(SU(m) R SO(n)) > 7 unless m > 4 and n = 3. 
Moreover c(U(m) R SO (3)) = 6 for m > 3. 
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Proof. By dimensional reasons, c(U(3) <g> SO(4)) > 9. Hence c(SU(m) <g> SO(n)) > 9 if 
m > 3 and n > 4. 

The case n = 3 is dealt with separately: 

c(SU(m) © SO(3)) = 1 + c(SU(m - 1) x SO(2), iR 2 © C m_1 © c C 2 ) 

= 2 + c(SU(m-l),2C m - 1 ) 

J 7, if m = 3, 
[ 6, if m > 3. 

A similar computation shows that c(U(m) © SO (3)) = 6 for m > 3. □ 

Lemma 13.3. We have: 

(a) c(U(m) ® Sp(2)) > 6 if m > A; 

(6) c(U(3) © Sp(2)) = 5 and c(SU(3) © Sp(2)) = 6; 

(c) c(SU(m) © Sp(n)) > 7 if m > 3 and n > 3. 

Proo/. By dimensional reasons, c(U(4)©Sp(2)) > 6, c(U(4)©Sp(3)) > 11 and c(SU(3)© 
Sp(3)) > 7. Hence (a) and (c) follow from Lemma [12.11 

On the other hand, one computes directly that c(U(3) © Sp(2)) = 5, from which follows 
c(SU(3) © Sp(2)) = 6. This proves (b). □ 

14. The case G = G x x G 2 , V = V x ® R V 2 

Here G\ and G 2 are non- necessarily simple, pi = (Gi, Vj) are real irreducible representations 
and at least one of them is of real type. Let m = dimR^i < n = dimRV^. Recall that 
SO(m) g) SO(n) is polar. Since c(p) = 4 or 5, in view of Subsection 112.51 we may assume 
that 2 < m < 4. Moreover, owing to the next lemma, c(pi) = c(p 2 ) = 1. 

Lemma 14.1. Let p\ = (Gi, V\) and p 2 = (G 2 , V 2 ) be real irreducible non-trivial representa- 
tions (non-necessarily of real type) and consider their real tensor product p = (G, V), where 
G = G\ x G 2 and V = V\ ®r V 2 . If either p\ or p 2 has cohomogeneity bigger than one, then 
c{p) > 6. 

Proof. Fix v = v\ <8> v 2 G V where v , G Vi is Gj-regular. Write H = (G v )° and Hi = 
((Gi) Vi )°. Then H = Hi x H 2 . Without loss of generality, we may assume that c(pi) = 1 
and n = c(p 2 ) > 2. Then 

c(p) = n + c(H, Vi ® v 2 ). 
Put U = T V2 (G 2 v 2 ). Then U + and 

Vi®V2=(n - l)vi ® R © ^ ® C/. 

If n > 3, then it follows from the above that c(p) > 6. Suppose n = 2. Then p 2 is polar 
and G 2 (v 2 ) is an isoparametric submanifold of V 2 . Since p 2 is irreducible, G 2 {v 2 ) has at 
least 3 distinct principal curvatures so U has at least 3 if2-i rr educible components. Thus 
c(if, v i © U) > 3 and it follows that 

c(H,Vi® v 2 ) > 4 

and 

c(p) > 2 + 4 = 6, 

as desired. □ 
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14.1. m = 2. Then p\ = (SO(2),R 2 ). Also, P2 = {G 2 ,V 2 ) is of real type. Running through 
the cases in which c(p 2 ) = 1, the only non-polar p that we get are (SO(2)xSpin(9),R 2 ®R 16 ), 
and (SO(2) x Sp(n )Sp(l), R 2 ® (H n <g> H H)) where n > 2, both of which have c(p) = 3 and 
copolarity 1 jGTOOl Prop. 7.12]. 

14.2. m = 3 or 4. Assume first that pi = (SO(m), R m ). Running through the cases in which 
p2 is of real type and using the dimension bound, we get that p is one of (SO (3) x G2, R 3 ® 
R 7 ), (SO(3) x Spin(7),R 3 <g> R 8 ) or (SO(4) x Spin(7),R 4 <g> R 8 ). (Note that c(SO(m) ® 
Sp(n)Sp(l)) > 8 for m > 3 and n > 2 by Lemma [13.11 ) The second representation is orbit 
equivalent to (S O(3) x SO(8), R 3 ® R 8 ) and hence polar [EH99j . The first one has c(p) = 4 
and copolarity 2 |GT03l Lemma 6.11]. The last one has c(p) = 5 and copolarity 3, which can 
be checked via a similar reasoning as in [GTOBl Lemma 6.11] and using Lemma 7.13 loc.cit. 
If P2 is not of real type, we invoke Section[13]to get one more example, namely SO(3) <8>U(2). 

Finally, the only other possibilities for p\ are that it equals (SU(2), C 2 ) or (U(2),C 2 ). 
Then P2 is of real type; again this case is covered by Section [13] and we get no other examples. 

15. The case G = G x x G 2 , V = V x <g> H V 2 

In principle, G\ and G2 could be non-simple. The pi = (Gi,Vi) are real irreducible 
representations and both of them are of quaternionic type. The first remark is that we may 
assume that G\ and G2 are simple. Indeed, if, say G2, is not simple, then V2 is a tensor 
product W\ ®r W 2 where W x is of real type and W 2 is of quaternionic type; by rearranging 
the factors in V we see that this case is included in Section [TU Recall that Sp(m) £g> Sp(n) 
is polar, so this case will be omitted in the sequel. 

Assume G\ = Sp(l). If V\ = H then we must have c(p2) < c(p) + dimSp(l) < 8. Since 
G2 is simple, running through the list in section 112.8.21 we get five polar representations p 
associated to irreducible quaternionic-Kahler symmetric spaces. 

For m > 3, we have c(Sp(n), m ■ H n ) > 8 for n > 1. Therefore c(Sp(l) x G 2 , H m ® H V 2 ) > 
c(Sp(l) x Sp(n),H m ® H H n ) > c(Sp(n),m ■ H n ) - 3 > 5. Moreover, if c(p 2 ) > 1 then 
c(p 2 ) > 5, due to Subsection [TM21 Hence c(2p 2 ) > 10 and c(Sp(l) x G 2 , H 2 ® H V 2 ) > 7. 

In the case G± = Sp(l), we are thus left with the representations (Sp(l) x Sp(n), H 2 ®h 
H n ), but they have cohomogeneity 3 and copolarity 1 |GT00[ Prop. 7.12]. 

Thus we may assume that both groups Gj are not equal to Sp(l). Let m = dim H V\ < 
n = dim H V 2 . Since Sp(m) (g) Sp(ra) is polar and we are interested in the cases c(p) = 4 or 
5, we may assume that m < 4. Hence 2 < m < 4 and we deduce that pi(G\) = Sp(m). 

We rule out those cases by showing c(p) > 6 as follows. In view of Lemma 112. 1[ we 
may assume m = 2. Now if c{p 2 ) > 8, then the same argument as above, together with 
dim(Cri) = 10, implies that c(p) > 2 • 8 — 10 = 6. Hence it remains to check for P2 equal to 
one of the four representations in the table in Subsection 112.8.21 In all cases, we finish by 
using the basic dimension bound. 

16. The remaining case: G = Gi x G 2 , V — V\ <g>c V 2 

For p = (G, V) with G non-simple, we may assume that all tensor products in V are over 
C due to Sections [TU and [151 It follows that there are no factors of real type and at most 
one factor of quaternionic type. It is also useful to recall that SU(m) ®U(n) is always polar 
and SU(m) <g> SU(n) is polar if and only if m 7^ n; otherwise, it has cohomogeneity m + 1 
and copolarity m — 1 [GOT041 § 3.3]. 
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Consider first the case p = (U(l) x G 2 , C ®c V 2 ) where G 2 is simple, p 2 = (G 2 , V%) is 
real irreducible of complex or quaternionic type and c(p 2 ) > 1. A glance at the tables in 
Section H2.8I yields only one example, namely, (U(2),C 4 ). We will show there is only one 
further example, with cohomogeneity 5, a circle factor and trivial principal isotropy group. 
Hence we may assume in the sequel that a circle factor is always present. 

Assume the factor of quaternionic type is present. We consider first the case p(G) C 
SU(2) ® SU(m) ® U(n) = SU(2) ® U(m) ® SU(n) where 3 < m < n. It follows from 
Lemma fl 2. II that c m ^ n = c(SU(2) ® SU(m) <g) U(n)) increases with m and n, but note that 
C3,3 > 16 by dimensional reasons. 

Consider next the case p is of the form (U(2) x G 2 , C 2 ®c V 2 ), where p 2 = (G 2 , V 2 ) is real 
irreducible of complex type with G 2 simple. We have c(p) > c(2p 2 ) — 4 > 2c(p 2 ) — 4 > 6 for 
c(p 2 ) > 5. Otherwise 2 < c(p 2 ) < 4 and we can use the dimension bound to rule out the few 
possibilities given in the tables in Section 112.81 

Hence if the factor of quaternionic type is present, the discussion in Section [13] yields that 
p is U(3) ® Sp(2). 

Finally we consider the case in which all factors are of complex type. The case p(G) C 
SU(m) (g) SU(n) ® U(p) where 3<m<n<pis discarded by means of Lemma 112.11 as 
above. Hence we may assume that G is the product of two simple groups and a circle factor. 
Now p(G) C U(m) <S> SU(n) = SU(m) ® U(n) and we may assume m < n. Since we are 
interested in c(p) = 4 or 5, in view of Subsection 112.51 we may assume m = 3 or 4. Again 
invoking Lemma H2. 1[ it suffices to exclude the case p = (U(3) x G 2 , C 3 ®c V2) where G 2 is 
simple. In this case c(p) > c(3p 2 ) — 9 > 3c(p 2 ) — 9 > 6 if c(p 2 ) > 5. On the other hand, for 
2 < C (P2) < 4 the few cases given in the tables in Section ["12.8l are excluded by the dimension 
bound. 

17. Final arguments 

We are going to finish the proofs of Theorem 11.41 and Corollary 11.51 

Collecting the lists of Subsection 112.81 as well as the results of Sections H4"t [TBI and [TBI yields 
the first two columns of the Tables 1 and 2. It remains to verify the statements about the 
copolarities and the boundaries. 

All but the first two representations in cohomogeneity 4 have been shown to admit re- 
ductions to minimal generalized sections with the torus T 2 as the identity component of 
the group acting on it |GOT04j . Since these actions admit reductions, their quotients have 
non-empty boundary. On the other hand, for the first two representations, the quotients 
do not have boundary (owing to Section [10], which is independent of Theorem |1.4p . Due to 
Proposition I5.2[ these representations do not admit reductions. 

In the same way all but two representations of cohomogeneity 5 admit reductions to 
minimal generalized sections with 3-dimensional tori as the identity component of the group 
acting on it (see Subsection 114.21 and |GOT04j ). and the orbit space of SU(2) on C 4 has no 
boundary. 

For the remaining two presentations, one is a reduction of the second via a generalized 
section. Namely, for the representation of U(3) x Sp(2) we enlarge the group by adjoin- 
ing complex conjugation of matrices to obtain an orbit equivalent representation. The new 
representation has non-trivial principal isotropy group whose fixed point, given by the sub- 
space of real matrices, is a generalized section and the representation space of SO(3) x U(2). 
Therefore both quotients are isometric and have non-empty boundaries. It remains to prove 
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that the representation p of SO (3) x U(2) on R 3 ® R 4 has trivial copolarity. Since this 
information is not needed in the proof of Theorem ll.2[ we can use this theorem to show that 
the abstract copolarity of p is trivial as follows. The dimension of SO (3) x U(2) is 7. If it had 
a minimal reduction to a representation of a group G with dim(G) < 6, then the restricted 
representation of G° would be reducible, due to Proposition 19.11 Hence one could apply 
Theorem II .21 to deduce that the representation of SO(3) x U(2) must have copolarity equal 
to the abstract copolarity equal to 3. One could either argue directly that p does not admit 
a reduction to a finite extension of its maximal torus, or, more elegantly, use Corollary 17. 51 to 
deduce that p must have non-trivial principal isotropy groups. This provides a contradiction 
and finishes the proof of Theorem 11.41 

In regard to Corollary 11.51 and its assertion about representations of cohomogeneity at 
most 5, it remains only to check that the copolarity and abstract copolarity must be equal for 
the representations of copolarity 2 in Table 1 and those of copolarity 3 in Table 2. Since those 
representations admit reductions to finite extensions of tori, this follows from an application 
of Theorem 11.21 Finally, the assertion about representations of abstract copolarity at most 6 
follows from Proposition 19.11 and Theorem 11.21 
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